[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:04 dist-test-slave-1vmg krb5kdc[22720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:04 dist-test-slave-1vmg krb5kdc[22720](info): set up 2 sockets
Aug 05 23:00:04 dist-test-slave-1vmg krb5kdc[22720](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260805 23:00:05.979874 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.334s user 0.002s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:06 dist-test-slave-1vmg krb5kdc[22720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:06.195813 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41751
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:41751
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:06.560585 22741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:06.560943 22741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:06.561081 22741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:06.569355 22741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:06.569531 22741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:06.569711 22741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:06.569841 22741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:06.569911 22741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:06.581063 22741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:41751
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:06.582988 22741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:06.584679 22741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:06.599129 22752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:06.599140 22750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:06.599030 22748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:06.599460 22741 server_base.cc:1034] running on GCE node
I20260805 23:00:06.600700 22741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:06.602502 22741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:06.603782 22741 hybrid_clock.cc:648] HybridClock initialized: now 1785970806603726 us; error 50 us; skew 500 ppm
I20260805 23:00:06.604228 22741 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:06 dist-test-slave-1vmg krb5kdc[22720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970806, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:06.609364 22741 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:06.612037 22741 webserver.cc:460] Webserver started at http://127.22.45.126:34305/ using document root <none> and password file <none>
I20260805 23:00:06.612936 22741 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:06.613087 22741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:06.613449 22741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:06.617396 22741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc"
format_stamp: "Formatted at 2026-08-05 23:00:06 on dist-test-slave-1vmg"
server_key: "217e9dbf8824f8a6c15116e4bc6a4334"
server_key_iv: "4c14b6c2260095a3e490cdb89f141c22"
server_key_version: "encryptionkey@0"
I20260805 23:00:06.618377 22741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc"
format_stamp: "Formatted at 2026-08-05 23:00:06 on dist-test-slave-1vmg"
server_key: "217e9dbf8824f8a6c15116e4bc6a4334"
server_key_iv: "4c14b6c2260095a3e490cdb89f141c22"
server_key_version: "encryptionkey@0"
I20260805 23:00:06.625097 22741 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260805 23:00:06.629518 22761 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:06.631313 22741 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260805 23:00:06.631529 22741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc"
format_stamp: "Formatted at 2026-08-05 23:00:06 on dist-test-slave-1vmg"
server_key: "217e9dbf8824f8a6c15116e4bc6a4334"
server_key_iv: "4c14b6c2260095a3e490cdb89f141c22"
server_key_version: "encryptionkey@0"
I20260805 23:00:06.631762 22741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:06.679774 22741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:06.687143 22741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:06.687532 22741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:06.708564 22741 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:41751
I20260805 23:00:06.708571 22826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:41751 every 8 connection(s)
I20260805 23:00:06.710290 22741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:06.714883 22828 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:06.718873 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 22741
I20260805 23:00:06.719285 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:06.721426 22709 external_mini_cluster.cc:1428] Setting key 0b54b795a20ed28ceb7b3cce9640691e
I20260805 23:00:06.728096 22828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc: Bootstrap starting.
I20260805 23:00:06.732766 22828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:06.734251 22828 log.cc:824] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:06.738152 22828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc: No bootstrap required, opened a new log
I20260805 23:00:06.747726 22828 raft_consensus.cc:348] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41751 } }
I20260805 23:00:06.748229 22828 raft_consensus.cc:374] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:06.748330 22828 raft_consensus.cc:729] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be97bdc6fe6d45f69a5e8ef77bb4a2fc, State: Initialized, Role: FOLLOWER
I20260805 23:00:06.749008 22828 consensus_queue.cc:260] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41751 } }
I20260805 23:00:06.749265 22828 raft_consensus.cc:388] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:06.749408 22828 raft_consensus.cc:482] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:06.749598 22828 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:06.752286 22828 raft_consensus.cc:504] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41751 } }
I20260805 23:00:06.752995 22828 leader_election.cc:302] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be97bdc6fe6d45f69a5e8ef77bb4a2fc; no voters:
Aug 05 23:00:06 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970806, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:06.753823 22828 leader_election.cc:288] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:06.753997 22836 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:06.755162 22836 raft_consensus.cc:686] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [term 1 LEADER]: Becoming Leader. State: Replica: be97bdc6fe6d45f69a5e8ef77bb4a2fc, State: Running, Role: LEADER
I20260805 23:00:06.755841 22836 consensus_queue.cc:237] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41751 } }
I20260805 23:00:06.756695 22828 sys_catalog.cc:564] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:06.759627 22837 sys_catalog.cc:455] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41751 } } }
I20260805 23:00:06.760125 22837 sys_catalog.cc:458] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:06.759604 22838 sys_catalog.cc:455] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader be97bdc6fe6d45f69a5e8ef77bb4a2fc. Latest consensus state: current_term: 1 leader_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be97bdc6fe6d45f69a5e8ef77bb4a2fc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41751 } } }
I20260805 23:00:06.764917 22838 sys_catalog.cc:458] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:06.765686 22842 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:06.771917 22842 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:06.773132 22830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:06.726031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54280 (local address 127.22.45.126:41751)
0805 23:00:06.727002 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:06.727022 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:06.728403 (+ 1381us) server_negotiation.cc:407] Connection header received
0805 23:00:06.738333 (+ 9930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:06.738363 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:06.738862 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:06.739361 (+ 499us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:06.743020 (+ 3659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:06.744597 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:06.746740 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:06.747579 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:06.747800 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:06.755670 (+ 7870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:06.755685 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:06.755738 (+ 53us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:06.755806 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:06.762489 (+ 6683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:06.764268 (+ 1779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:06.764279 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:06.764293 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:06.764593 (+ 300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:06.765565 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:06.765570 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:06.765573 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:06.766655 (+ 1082us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:06.767075 (+ 420us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:06.770372 (+ 3297us) server_negotiation.cc:299] Negotiation successful
0805 23:00:06.771085 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":427,"threads_started":1}
I20260805 23:00:06.785506 22842 catalog_manager.cc:1347] Generated new cluster ID: 694c846d330d4294b04ee3c4705d0915
I20260805 23:00:06.785668 22842 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:06.816438 22842 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:06.817927 22842 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:06.824573 22842 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be97bdc6fe6d45f69a5e8ef77bb4a2fc: Generated new TSK 0
I20260805 23:00:06.825629 22842 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:06.886516 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41751
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:07.269196 22866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:07.269527 22866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:07.269644 22866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:07.277380 22866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:07.277554 22866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:07.277686 22866 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:07.288306 22866 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:07.289710 22866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:07.291074 22866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:07.304757 22875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:07.304695 22874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:07.304776 22879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:07.305635 22866 server_base.cc:1034] running on GCE node
I20260805 23:00:07.306268 22866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:07.307353 22866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:07.308591 22866 hybrid_clock.cc:648] HybridClock initialized: now 1785970807308533 us; error 51 us; skew 500 ppm
I20260805 23:00:07.308987 22866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:07 dist-test-slave-1vmg krb5kdc[22720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970807, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:07.312611 22866 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:07.314427 22866 webserver.cc:460] Webserver started at http://127.22.45.65:32839/ using document root <none> and password file <none>
I20260805 23:00:07.315325 22866 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:07.315472 22866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:07.315835 22866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:07.319447 22866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "b5740631f74d42e9bc33bb8c013cea06"
format_stamp: "Formatted at 2026-08-05 23:00:07 on dist-test-slave-1vmg"
server_key: "5e2d7c87dfd23bb5795ccf323a5e8942"
server_key_iv: "ce57393af76d4f3f6ca28f2413bca6ee"
server_key_version: "encryptionkey@0"
I20260805 23:00:07.320405 22866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "b5740631f74d42e9bc33bb8c013cea06"
format_stamp: "Formatted at 2026-08-05 23:00:07 on dist-test-slave-1vmg"
server_key: "5e2d7c87dfd23bb5795ccf323a5e8942"
server_key_iv: "ce57393af76d4f3f6ca28f2413bca6ee"
server_key_version: "encryptionkey@0"
I20260805 23:00:07.327495 22866 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260805 23:00:07.333184 22887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:07.334807 22866 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260805 23:00:07.335055 22866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "b5740631f74d42e9bc33bb8c013cea06"
format_stamp: "Formatted at 2026-08-05 23:00:07 on dist-test-slave-1vmg"
server_key: "5e2d7c87dfd23bb5795ccf323a5e8942"
server_key_iv: "ce57393af76d4f3f6ca28f2413bca6ee"
server_key_version: "encryptionkey@0"
I20260805 23:00:07.335302 22866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:07.351533 22866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:07.357092 22866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:07.357479 22866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:07.358848 22866 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:07.360983 22866 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:07.361115 22866 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:07.361291 22866 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:07.361397 22866 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:07.397001 22866 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:36483
I20260805 23:00:07.397023 23047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:36483 every 8 connection(s)
I20260805 23:00:07.398463 22866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:07.401096 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 22866
I20260805 23:00:07.401371 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:07.402220 22709 external_mini_cluster.cc:1428] Setting key 740756adf5f8119f5376e5181074a368
Aug 05 23:00:07 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970807, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:00:07.422078 23050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:07.402711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:33403 (local address 127.22.45.126:41751)
0805 23:00:07.403290 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:07.403297 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:07.403933 (+ 636us) server_negotiation.cc:407] Connection header received
0805 23:00:07.406401 (+ 2468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:07.406407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:07.406517 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:07.406618 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:07.408516 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.409326 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.411085 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.411515 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.411645 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:07.415809 (+ 4164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:07.415815 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:07.415818 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:07.415858 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:07.418529 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:07.419502 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:07.419508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:07.419511 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:07.419659 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:07.420158 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:07.420162 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:07.420165 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:07.420459 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:07.420603 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:07.421454 (+ 851us) server_negotiation.cc:299] Negotiation successful
0805 23:00:07.421716 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":320,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
I20260805 23:00:07.423209 23051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:07.402666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41751 (local address 127.22.45.65:33403)
0805 23:00:07.403727 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:07.403788 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:07.406035 (+ 2247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:07.406968 (+ 933us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:07.406983 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:07.407616 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:07.408303 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:07.408325 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.409527 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.409531 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:07.410886 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:07.410903 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.411789 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.411797 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:07.412054 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:07.412786 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:07.412813 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:07.415492 (+ 2679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:07.418736 (+ 3244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:07.418747 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:07.418764 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:07.419348 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:07.419802 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:07.419807 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:07.419811 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:07.420029 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:07.420598 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:07.420608 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:07.421026 (+ 418us) client_negotiation.cc:769] Sending connection context
0805 23:00:07.421291 (+ 265us) client_negotiation.cc:240] Negotiation successful
0805 23:00:07.421895 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":478,"threads_started":1}
I20260805 23:00:07.424906 23048 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41751
I20260805 23:00:07.425307 23048 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:07.426254 23048 heartbeater.cc:511] Master 127.22.45.126:41751 requested a full tablet report, sending...
I20260805 23:00:07.429023 22781 ts_manager.cc:194] Registered new tserver with Master: b5740631f74d42e9bc33bb8c013cea06 (127.22.45.65:36483)
I20260805 23:00:07.430585 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:33403
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:07.447150 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41751
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:07.810616 23055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:07.811049 23055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:07.811203 23055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:07.819079 23055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:07.819247 23055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:07.819413 23055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:07.830503 23055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:07.832024 23055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:07.833487 23055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:07.847685 23063 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:07.848167 23065 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:07.848228 23061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:07.848703 23055 server_base.cc:1034] running on GCE node
I20260805 23:00:07.849362 23055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:07.850440 23055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:07.851692 23055 hybrid_clock.cc:648] HybridClock initialized: now 1785970807851630 us; error 61 us; skew 500 ppm
I20260805 23:00:07.852070 23055 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:07 dist-test-slave-1vmg krb5kdc[22720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970807, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:07.855736 23055 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:07.857626 23055 webserver.cc:460] Webserver started at http://127.22.45.66:46849/ using document root <none> and password file <none>
I20260805 23:00:07.858443 23055 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:07.858582 23055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:07.858954 23055 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:07.862546 23055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "7f246b7a4a554a6bb6ffc641d0c1d632"
format_stamp: "Formatted at 2026-08-05 23:00:07 on dist-test-slave-1vmg"
server_key: "4b33f642245ee60b88f095ff289407e9"
server_key_iv: "4e7a234787862980cefea44294c1aac8"
server_key_version: "encryptionkey@0"
I20260805 23:00:07.863564 23055 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "7f246b7a4a554a6bb6ffc641d0c1d632"
format_stamp: "Formatted at 2026-08-05 23:00:07 on dist-test-slave-1vmg"
server_key: "4b33f642245ee60b88f095ff289407e9"
server_key_iv: "4e7a234787862980cefea44294c1aac8"
server_key_version: "encryptionkey@0"
I20260805 23:00:07.870052 23055 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:07.874531 23074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:07.876191 23055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:07.876385 23055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "7f246b7a4a554a6bb6ffc641d0c1d632"
format_stamp: "Formatted at 2026-08-05 23:00:07 on dist-test-slave-1vmg"
server_key: "4b33f642245ee60b88f095ff289407e9"
server_key_iv: "4e7a234787862980cefea44294c1aac8"
server_key_version: "encryptionkey@0"
I20260805 23:00:07.876628 23055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:07.903832 23055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:07.908674 23055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:07.908998 23055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:07.910146 23055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:07.911675 23055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:07.911763 23055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:07.911882 23055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:07.911934 23055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:07.946189 23055 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:46435
I20260805 23:00:07.946257 23227 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:46435 every 8 connection(s)
I20260805 23:00:07.947666 23055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:07.949602 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 23055
I20260805 23:00:07.949796 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:07.950224 22709 external_mini_cluster.cc:1428] Setting key 6119dc680e74cc21a2dabfd502be2dc3
Aug 05 23:00:07 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970807, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:00:07.971823 23232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:07.950553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:58409 (local address 127.22.45.126:41751)
0805 23:00:07.951124 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:07.951131 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:07.952330 (+ 1199us) server_negotiation.cc:407] Connection header received
0805 23:00:07.955077 (+ 2747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:07.955081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:07.955188 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:07.955282 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:07.957618 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.958439 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.960360 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.961039 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.961188 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:07.965389 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:07.965394 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:07.965398 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:07.965439 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:07.968161 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:07.969269 (+ 1108us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:07.969273 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:07.969276 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:07.969416 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:07.969965 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:07.969969 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:07.969971 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:07.970278 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:07.970403 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:07.971275 (+ 872us) server_negotiation.cc:299] Negotiation successful
0805 23:00:07.971471 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":273,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
I20260805 23:00:07.972857 23234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:07.951273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41751 (local address 127.22.45.66:58409)
0805 23:00:07.952157 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:07.952209 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:07.954691 (+ 2482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:07.955592 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:07.955604 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:07.956462 (+ 858us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:07.957377 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:07.957405 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.958619 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.958625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:07.960167 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:07.960183 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:07.961270 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:07.961276 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:07.961500 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:07.962275 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:07.962300 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:07.965039 (+ 2739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:07.968373 (+ 3334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:07.968386 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:07.968407 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:07.969135 (+ 728us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:07.969529 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:07.969535 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:07.969538 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:07.969841 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:07.970394 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:07.970401 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:07.970812 (+ 411us) client_negotiation.cc:769] Sending connection context
0805 23:00:07.971118 (+ 306us) client_negotiation.cc:240] Negotiation successful
0805 23:00:07.971573 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":365,"threads_started":1}
I20260805 23:00:07.974466 23228 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41751
I20260805 23:00:07.974864 23228 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:07.975814 23228 heartbeater.cc:511] Master 127.22.45.126:41751 requested a full tablet report, sending...
I20260805 23:00:07.977524 22781 ts_manager.cc:194] Registered new tserver with Master: 7f246b7a4a554a6bb6ffc641d0c1d632 (127.22.45.66:46435)
I20260805 23:00:07.978675 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:58409
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:07.996295 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41751
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:42651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:08.362031 23244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:08.362401 23244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:08.362532 23244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:08.370235 23244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:08.370411 23244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:08.370566 23244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:08.381098 23244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:42651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41751
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:08.382542 23244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:08.384125 23244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:08.398977 23250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:08.399016 23253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:08.399046 23251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:08.400450 23244 server_base.cc:1034] running on GCE node
I20260805 23:00:08.401242 23244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:08.402341 23244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:08.403589 23244 hybrid_clock.cc:648] HybridClock initialized: now 1785970808403522 us; error 57 us; skew 500 ppm
I20260805 23:00:08.403950 23244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:08.407366 23244 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:08.408916 23244 webserver.cc:460] Webserver started at http://127.22.45.67:36955/ using document root <none> and password file <none>
I20260805 23:00:08.409653 23244 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:08.409785 23244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:08.410112 23244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:08.413429 23244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "dad854a8f58346018523acb28eb052a4"
format_stamp: "Formatted at 2026-08-05 23:00:08 on dist-test-slave-1vmg"
server_key: "1cd87ebd0b059e45ad3cb53926bde9ef"
server_key_iv: "fb59ed9be503bdbffe2254a640a1dd01"
server_key_version: "encryptionkey@0"
I20260805 23:00:08.414289 23244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "dad854a8f58346018523acb28eb052a4"
format_stamp: "Formatted at 2026-08-05 23:00:08 on dist-test-slave-1vmg"
server_key: "1cd87ebd0b059e45ad3cb53926bde9ef"
server_key_iv: "fb59ed9be503bdbffe2254a640a1dd01"
server_key_version: "encryptionkey@0"
I20260805 23:00:08.420403 23244 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:00:08.424265 23262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:08.425652 23244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:00:08.425844 23244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "dad854a8f58346018523acb28eb052a4"
format_stamp: "Formatted at 2026-08-05 23:00:08 on dist-test-slave-1vmg"
server_key: "1cd87ebd0b059e45ad3cb53926bde9ef"
server_key_iv: "fb59ed9be503bdbffe2254a640a1dd01"
server_key_version: "encryptionkey@0"
I20260805 23:00:08.426054 23244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:08.434128 23048 heartbeater.cc:503] Master 127.22.45.126:41751 was elected leader, sending a full tablet report...
I20260805 23:00:08.447707 23244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:08.452467 23244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:08.452787 23244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:08.453914 23244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:08.455540 23244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:08.455629 23244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:08.455773 23244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:08.455832 23244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:08.489931 23244 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:37887
I20260805 23:00:08.489993 23425 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:37887 every 8 connection(s)
I20260805 23:00:08.491482 23244 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:08.498067 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 23244
I20260805 23:00:08.498301 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:08.498898 22709 external_mini_cluster.cc:1428] Setting key 36f25497212fb46f87169f130c97c3c5
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:08.515771 23428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:08.494591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:35747 (local address 127.22.45.126:41751)
0805 23:00:08.495101 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:08.495106 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:08.496374 (+ 1268us) server_negotiation.cc:407] Connection header received
0805 23:00:08.498862 (+ 2488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:08.498867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:08.499006 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:08.499139 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:08.501494 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.502351 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.504202 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.504654 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.504782 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:08.508965 (+ 4183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:08.508971 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:08.508974 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:08.509024 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:08.511875 (+ 2851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.512838 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.512843 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.512845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.512996 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.513496 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.513501 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.513504 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.513823 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:08.513981 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:08.515049 (+ 1068us) server_negotiation.cc:299] Negotiation successful
0805 23:00:08.515332 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":231,"threads_started":1}
I20260805 23:00:08.516912 23429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:08.495335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41751 (local address 127.22.45.67:35747)
0805 23:00:08.496164 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:08.496230 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:08.498437 (+ 2207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:08.499498 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:08.499513 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:08.500348 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:08.501263 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:08.501299 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.502534 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.502538 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:08.504007 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:08.504027 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.504955 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.504964 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:08.505218 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:08.505995 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:08.506041 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:08.508654 (+ 2613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:08.512091 (+ 3437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:08.512101 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:08.512118 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:08.512675 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:08.513132 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:08.513136 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:08.513138 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:08.513365 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:08.513970 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:08.513979 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:08.514543 (+ 564us) client_negotiation.cc:769] Sending connection context
0805 23:00:08.514861 (+ 318us) client_negotiation.cc:240] Negotiation successful
0805 23:00:08.515564 (+ 703us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":339,"threads_started":1}
I20260805 23:00:08.518497 23426 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41751
I20260805 23:00:08.518865 23426 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:08.519771 23426 heartbeater.cc:511] Master 127.22.45.126:41751 requested a full tablet report, sending...
I20260805 23:00:08.521488 22781 ts_manager.cc:194] Registered new tserver with Master: dad854a8f58346018523acb28eb052a4 (127.22.45.67:37887)
I20260805 23:00:08.522361 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:35747
I20260805 23:00:08.529212 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:08.582610 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:08.564540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49384 (local address 127.22.45.65:36483)
0805 23:00:08.565196 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:08.565207 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:08.565678 (+ 471us) server_negotiation.cc:407] Connection header received
0805 23:00:08.565878 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:08.565886 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:08.566132 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:08.566297 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:08.568025 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.569154 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.570559 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.571314 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.571451 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:08.575928 (+ 4477us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:08.575946 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:08.575963 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:08.576015 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:08.579307 (+ 3292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.580168 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.580177 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.580179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.580380 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.580842 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.580846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.580849 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.581250 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:08.581562 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:08.581939 (+ 377us) server_negotiation.cc:299] Negotiation successful
0805 23:00:08.582240 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":303,"threads_started":1}
W20260805 23:00:08.583958 22927 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49384
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:08.636248 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:08.620253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49396 (local address 127.22.45.65:36483)
0805 23:00:08.620458 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:08.620465 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:08.620870 (+ 405us) server_negotiation.cc:407] Connection header received
0805 23:00:08.621065 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:08.621070 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:08.621144 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:08.621251 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:08.622783 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.623567 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.624900 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.625354 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.625479 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:08.630017 (+ 4538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:08.630024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:08.630028 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:08.630078 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:08.633127 (+ 3049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.634010 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.634016 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.634019 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.634210 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.634662 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.634667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.634670 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.635090 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:08.635337 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:08.635703 (+ 366us) server_negotiation.cc:299] Negotiation successful
0805 23:00:08.635921 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 23:00:08.637951 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 22866
I20260805 23:00:08.655294 23433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:08.639213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49412 (local address 127.22.45.65:36483)
0805 23:00:08.639447 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:08.639453 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:08.639746 (+ 293us) server_negotiation.cc:407] Connection header received
0805 23:00:08.639917 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:08.639921 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:08.639989 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:08.640087 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:08.641473 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.642264 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.643861 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.644409 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.644533 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:08.647439 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:08.647445 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:08.647449 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:08.647497 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:08.652056 (+ 4559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.652993 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.652998 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.653001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.653171 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.653601 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.653605 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.653607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.653925 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:08.654124 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:08.654463 (+ 339us) server_negotiation.cc:299] Negotiation successful
0805 23:00:08.654900 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:00:08.656201 23043 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:08.750567 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 22866
I20260805 23:00:08.773423 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 23055
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:08.797583 23446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:08.774772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60752 (local address 127.22.45.66:46435)
0805 23:00:08.776424 (+ 1652us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:08.776434 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:08.776469 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:00:08.776546 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:08.776554 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:08.776950 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:08.777140 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:08.779182 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.780354 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.782149 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.782879 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.783078 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:08.788610 (+ 5532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:08.788647 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:08.788669 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:08.788725 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:08.792435 (+ 3710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.794120 (+ 1685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.794131 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.794133 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.794383 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.795224 (+ 841us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.795229 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.795231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.795725 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:08.796016 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:08.796725 (+ 709us) server_negotiation.cc:299] Negotiation successful
0805 23:00:08.797048 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1433,"thread_start_us":1236,"threads_started":1}
I20260805 23:00:08.799238 23222 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:08.887327 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 23055
I20260805 23:00:08.912937 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 23244
Aug 05 23:00:08 dist-test-slave-1vmg krb5kdc[22720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970808, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:08.934000 23448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:08.914310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.22.45.67:37887)
0805 23:00:08.915318 (+ 1008us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:08.915326 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:08.915359 (+ 33us) server_negotiation.cc:407] Connection header received
0805 23:00:08.915425 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:08.915432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:08.915666 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:08.915815 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:08.917869 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.919057 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.921001 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:08.921822 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:08.921978 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:08.927391 (+ 5413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:08.927414 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:08.927431 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:08.927487 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:08.930659 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.931658 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.931667 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.931669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.931843 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:08.932219 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:08.932222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:08.932225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:08.932626 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:08.932877 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:08.933319 (+ 442us) server_negotiation.cc:299] Negotiation successful
0805 23:00:08.933597 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":822,"thread_start_us":629,"threads_started":1}
I20260805 23:00:08.935542 23418 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:09.021494 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 23244
I20260805 23:00:09.046667 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 22741
I20260805 23:00:09.048149 22821 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:09.153872 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 22741
2026-08-05T23:00:09Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4566 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:09 dist-test-slave-1vmg krb5kdc[23455](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:09 dist-test-slave-1vmg krb5kdc[23455](info): set up 2 sockets
Aug 05 23:00:09 dist-test-slave-1vmg krb5kdc[23455](info): commencing operation
krb5kdc: starting...
W20260805 23:00:10.342902 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:10 dist-test-slave-1vmg krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:10.555280 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46875
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:46875
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:10.909174 23476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:10.909538 23476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:10.909675 23476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:10.917276 23476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:10.917433 23476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:10.917484 23476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:10.917577 23476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:10.917639 23476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:10.928467 23476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:46875
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:10.930070 23476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:10.931586 23476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:10.945046 23485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:10.945086 23484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:10.945014 23488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:10.945796 23476 server_base.cc:1034] running on GCE node
I20260805 23:00:10.946738 23476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:10.948467 23476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:10.949731 23476 hybrid_clock.cc:648] HybridClock initialized: now 1785970810949673 us; error 56 us; skew 500 ppm
I20260805 23:00:10.950124 23476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:10 dist-test-slave-1vmg krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970810, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:10.958241 23476 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:10.960180 23476 webserver.cc:460] Webserver started at http://127.22.45.126:46143/ using document root <none> and password file <none>
I20260805 23:00:10.961015 23476 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:10.961150 23476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:10.961521 23476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:10.964962 23476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "751a7649bd0e418d8653b94e1e2d55e9"
format_stamp: "Formatted at 2026-08-05 23:00:10 on dist-test-slave-1vmg"
server_key: "b9330c7f3a3cbb09865f610b283e4862"
server_key_iv: "447583f0bba69b102a20e366e73aa503"
server_key_version: "encryptionkey@0"
I20260805 23:00:10.965819 23476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "751a7649bd0e418d8653b94e1e2d55e9"
format_stamp: "Formatted at 2026-08-05 23:00:10 on dist-test-slave-1vmg"
server_key: "b9330c7f3a3cbb09865f610b283e4862"
server_key_iv: "447583f0bba69b102a20e366e73aa503"
server_key_version: "encryptionkey@0"
I20260805 23:00:10.971563 23476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 23:00:10.975299 23497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:10.976842 23476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:00:10.977041 23476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "751a7649bd0e418d8653b94e1e2d55e9"
format_stamp: "Formatted at 2026-08-05 23:00:10 on dist-test-slave-1vmg"
server_key: "b9330c7f3a3cbb09865f610b283e4862"
server_key_iv: "447583f0bba69b102a20e366e73aa503"
server_key_version: "encryptionkey@0"
I20260805 23:00:10.977278 23476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:10.990357 23476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:10.995436 23476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:10.995770 23476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:11.015818 23476 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:46875
I20260805 23:00:11.015841 23569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:46875 every 8 connection(s)
I20260805 23:00:11.017491 23476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:11.022074 23572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:11.027912 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 23476
I20260805 23:00:11.028201 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:11.029066 22709 external_mini_cluster.cc:1428] Setting key 9319265510169123ac754b2102146248
I20260805 23:00:11.036600 23572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9: Bootstrap starting.
I20260805 23:00:11.041132 23572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:11.042524 23572 log.cc:824] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9: Log is configured to *not* fsync() on all Append() calls
Aug 05 23:00:11 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:11.046756 23572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9: No bootstrap required, opened a new log
I20260805 23:00:11.058171 23572 raft_consensus.cc:348] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "751a7649bd0e418d8653b94e1e2d55e9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46875 } }
I20260805 23:00:11.058681 23572 raft_consensus.cc:374] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:11.058809 23572 raft_consensus.cc:729] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 751a7649bd0e418d8653b94e1e2d55e9, State: Initialized, Role: FOLLOWER
I20260805 23:00:11.059018 23577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:11.031573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44854 (local address 127.22.45.126:46875)
0805 23:00:11.032564 (+ 991us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:11.032579 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:11.032633 (+ 54us) server_negotiation.cc:407] Connection header received
0805 23:00:11.034584 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:11.034615 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:11.035186 (+ 571us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:11.035601 (+ 415us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:11.038037 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:11.039601 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:11.041495 (+ 1894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:11.042374 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:11.042565 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:11.048054 (+ 5489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:11.048064 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:11.048085 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:11.048141 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:11.052054 (+ 3913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:11.053693 (+ 1639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:11.053704 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:11.053716 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:11.054014 (+ 298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:11.054571 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:11.054575 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:11.054577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:11.055528 (+ 951us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:11.055810 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:11.057003 (+ 1193us) server_negotiation.cc:299] Negotiation successful
0805 23:00:11.057618 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":441,"threads_started":1}
I20260805 23:00:11.059566 23572 consensus_queue.cc:260] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "751a7649bd0e418d8653b94e1e2d55e9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46875 } }
I20260805 23:00:11.059891 23572 raft_consensus.cc:388] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:11.060039 23572 raft_consensus.cc:482] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:11.060235 23572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:11.062978 23572 raft_consensus.cc:504] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "751a7649bd0e418d8653b94e1e2d55e9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46875 } }
I20260805 23:00:11.063647 23572 leader_election.cc:302] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 751a7649bd0e418d8653b94e1e2d55e9; no voters:
I20260805 23:00:11.064339 23572 leader_election.cc:288] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:11.064502 23580 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:11.065346 23580 raft_consensus.cc:686] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [term 1 LEADER]: Becoming Leader. State: Replica: 751a7649bd0e418d8653b94e1e2d55e9, State: Running, Role: LEADER
I20260805 23:00:11.066004 23580 consensus_queue.cc:237] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "751a7649bd0e418d8653b94e1e2d55e9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46875 } }
I20260805 23:00:11.067960 23572 sys_catalog.cc:564] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:11.069346 23581 sys_catalog.cc:455] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "751a7649bd0e418d8653b94e1e2d55e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "751a7649bd0e418d8653b94e1e2d55e9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46875 } } }
I20260805 23:00:11.069882 23581 sys_catalog.cc:458] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:11.069312 23582 sys_catalog.cc:455] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 751a7649bd0e418d8653b94e1e2d55e9. Latest consensus state: current_term: 1 leader_uuid: "751a7649bd0e418d8653b94e1e2d55e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "751a7649bd0e418d8653b94e1e2d55e9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46875 } } }
I20260805 23:00:11.070837 23582 sys_catalog.cc:458] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:11.072223 23587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:11.079564 23587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:11.091475 23587 catalog_manager.cc:1347] Generated new cluster ID: 49d65ee70a06404e9d649ff82df455c3
I20260805 23:00:11.091612 23587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:11.100378 23587 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:11.101855 23587 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:11.115118 23587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 751a7649bd0e418d8653b94e1e2d55e9: Generated new TSK 0
I20260805 23:00:11.116189 23587 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:11.171298 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46875
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:11.551505 23604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:11.551865 23604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:11.551998 23604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:11.559747 23604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:11.559923 23604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:11.560078 23604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:11.571067 23604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46875
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:11.572844 23604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:11.574344 23604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:11.589140 23617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:11.589192 23613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:11.589107 23611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:11.590611 23604 server_base.cc:1034] running on GCE node
I20260805 23:00:11.591444 23604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:11.592555 23604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:11.593797 23604 hybrid_clock.cc:648] HybridClock initialized: now 1785970811593726 us; error 65 us; skew 500 ppm
I20260805 23:00:11.594158 23604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:11 dist-test-slave-1vmg krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970811, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:11.597694 23604 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:11.599473 23604 webserver.cc:460] Webserver started at http://127.22.45.65:33021/ using document root <none> and password file <none>
I20260805 23:00:11.600286 23604 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:11.600423 23604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:11.600764 23604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:11.604313 23604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "05f57d9020ed46e5b5c8f6546ce8c934"
format_stamp: "Formatted at 2026-08-05 23:00:11 on dist-test-slave-1vmg"
server_key: "45a5bf8b6d17407ae76dc6e979fd8f01"
server_key_iv: "e5c6182f39c6b4779df79a9a8bba40a0"
server_key_version: "encryptionkey@0"
I20260805 23:00:11.605288 23604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "05f57d9020ed46e5b5c8f6546ce8c934"
format_stamp: "Formatted at 2026-08-05 23:00:11 on dist-test-slave-1vmg"
server_key: "45a5bf8b6d17407ae76dc6e979fd8f01"
server_key_iv: "e5c6182f39c6b4779df79a9a8bba40a0"
server_key_version: "encryptionkey@0"
I20260805 23:00:11.611840 23604 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 23:00:11.616031 23631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:11.617669 23604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260805 23:00:11.617904 23604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "05f57d9020ed46e5b5c8f6546ce8c934"
format_stamp: "Formatted at 2026-08-05 23:00:11 on dist-test-slave-1vmg"
server_key: "45a5bf8b6d17407ae76dc6e979fd8f01"
server_key_iv: "e5c6182f39c6b4779df79a9a8bba40a0"
server_key_version: "encryptionkey@0"
I20260805 23:00:11.618139 23604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:11.642396 23604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:11.647630 23604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:11.647979 23604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:11.649199 23604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:11.650823 23604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:11.650947 23604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:11.651106 23604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:11.651161 23604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:11.684983 23604 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:43635
I20260805 23:00:11.685034 23793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:43635 every 8 connection(s)
I20260805 23:00:11.686383 23604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:11.696369 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 23604
I20260805 23:00:11.696586 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:11.697217 22709 external_mini_cluster.cc:1428] Setting key 6f8f95a1473d6a50cd47ecc353d7a52b
Aug 05 23:00:11 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970811, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:11.710052 23797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:11.689080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:36191 (local address 127.22.45.126:46875)
0805 23:00:11.689532 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:11.689536 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:11.690525 (+ 989us) server_negotiation.cc:407] Connection header received
0805 23:00:11.692558 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:11.692563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:11.692656 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:11.692771 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:11.694465 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:11.695323 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:11.697211 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:11.697690 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:11.697844 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:11.702445 (+ 4601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:11.702452 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:11.702457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:11.702508 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:11.705863 (+ 3355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:11.707165 (+ 1302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:11.707171 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:11.707173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:11.707330 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:11.707915 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:11.707920 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:11.707922 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:11.708266 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:11.708394 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:11.709472 (+ 1078us) server_negotiation.cc:299] Negotiation successful
0805 23:00:11.709720 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":227,"threads_started":1}
I20260805 23:00:11.711501 23798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:11.689629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46875 (local address 127.22.45.65:36191)
0805 23:00:11.690345 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:11.690385 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:11.692215 (+ 1830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:11.692994 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:11.693004 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:11.693602 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:11.694277 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:11.694299 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:11.695519 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:11.695524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:11.697017 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:11.697036 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:11.697992 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:11.697998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:11.698358 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:11.699145 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:11.699173 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:11.702102 (+ 2929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:11.706099 (+ 3997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:11.706114 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:11.706139 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:11.706992 (+ 853us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:11.707458 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:11.707462 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:11.707466 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:11.707767 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:11.708405 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:11.708415 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:11.708942 (+ 527us) client_negotiation.cc:769] Sending connection context
0805 23:00:11.709278 (+ 336us) client_negotiation.cc:240] Negotiation successful
0805 23:00:11.709947 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":264,"threads_started":1}
I20260805 23:00:11.713727 23795 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46875
I20260805 23:00:11.714112 23795 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:11.714972 23795 heartbeater.cc:511] Master 127.22.45.126:46875 requested a full tablet report, sending...
I20260805 23:00:11.717736 23520 ts_manager.cc:194] Registered new tserver with Master: 05f57d9020ed46e5b5c8f6546ce8c934 (127.22.45.65:43635)
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:00:11.719642 23520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:36191
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:11.746856 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46875
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:12.100833 23802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:12.101186 23802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:12.101313 23802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:12.109522 23802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:12.109690 23802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:12.109851 23802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:12.120594 23802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46875
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:12.122184 23802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:12.123903 23802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:12.138677 23807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:12.138584 23810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:12.138629 23808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:12.140079 23802 server_base.cc:1034] running on GCE node
I20260805 23:00:12.140802 23802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:12.141867 23802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:12.143100 23802 hybrid_clock.cc:648] HybridClock initialized: now 1785970812143037 us; error 64 us; skew 500 ppm
I20260805 23:00:12.143472 23802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:12 dist-test-slave-1vmg krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970812, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:12.147099 23802 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:12.148917 23802 webserver.cc:460] Webserver started at http://127.22.45.66:32849/ using document root <none> and password file <none>
I20260805 23:00:12.149762 23802 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:12.149909 23802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:12.150265 23802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:12.153759 23802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "14a543c467324f159cf800336bb3b830"
format_stamp: "Formatted at 2026-08-05 23:00:12 on dist-test-slave-1vmg"
server_key: "930071524cb98c68b50a459cffb1cce4"
server_key_iv: "705a7724f6a970fd7ffc027005ed6ce5"
server_key_version: "encryptionkey@0"
I20260805 23:00:12.154709 23802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "14a543c467324f159cf800336bb3b830"
format_stamp: "Formatted at 2026-08-05 23:00:12 on dist-test-slave-1vmg"
server_key: "930071524cb98c68b50a459cffb1cce4"
server_key_iv: "705a7724f6a970fd7ffc027005ed6ce5"
server_key_version: "encryptionkey@0"
I20260805 23:00:12.160969 23802 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260805 23:00:12.165345 23820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:12.167019 23802 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:12.167234 23802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "14a543c467324f159cf800336bb3b830"
format_stamp: "Formatted at 2026-08-05 23:00:12 on dist-test-slave-1vmg"
server_key: "930071524cb98c68b50a459cffb1cce4"
server_key_iv: "705a7724f6a970fd7ffc027005ed6ce5"
server_key_version: "encryptionkey@0"
I20260805 23:00:12.167462 23802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:12.198486 23802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:12.204123 23802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:12.204478 23802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:12.205744 23802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:12.207854 23802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:12.207978 23802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:12.208155 23802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:12.208230 23802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:12.244412 23802 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:46697
I20260805 23:00:12.244540 23977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:46697 every 8 connection(s)
I20260805 23:00:12.245931 23802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:12.249807 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 23802
I20260805 23:00:12.250077 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:12.250593 22709 external_mini_cluster.cc:1428] Setting key b92a5b786693a6429f206fb6d59be6ce
Aug 05 23:00:12 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970812, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:00:12.274008 23980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.249652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:32893 (local address 127.22.45.126:46875)
0805 23:00:12.250222 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:12.250229 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:12.251588 (+ 1359us) server_negotiation.cc:407] Connection header received
0805 23:00:12.254099 (+ 2511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:12.254104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:12.254219 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:12.254407 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:12.257020 (+ 2613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.257948 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.260487 (+ 2539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.261169 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.261344 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.265824 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:12.265832 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:12.265838 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:12.265889 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:12.269641 (+ 3752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:12.270864 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:12.270869 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:12.270871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:12.271106 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:12.271796 (+ 690us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:12.271800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:12.271802 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:12.272195 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:12.272355 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:12.273279 (+ 924us) server_negotiation.cc:299] Negotiation successful
0805 23:00:12.273591 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":276,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
I20260805 23:00:12.275388 23982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.250389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46875 (local address 127.22.45.66:32893)
0805 23:00:12.251376 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:12.251443 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:12.253665 (+ 2222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:12.254774 (+ 1109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:12.254790 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:12.255724 (+ 934us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:12.256714 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.256746 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.258169 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.258175 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.260112 (+ 1937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.260132 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.261480 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.261486 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.261774 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.262568 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:12.262596 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:12.265424 (+ 2828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:12.269883 (+ 4459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:12.269894 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:12.269913 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:12.270683 (+ 770us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:12.271271 (+ 588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:12.271278 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:12.271282 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:12.271618 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:12.272366 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:12.272376 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:12.272834 (+ 458us) client_negotiation.cc:769] Sending connection context
0805 23:00:12.273125 (+ 291us) client_negotiation.cc:240] Negotiation successful
0805 23:00:12.273790 (+ 665us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":433,"threads_started":1}
I20260805 23:00:12.277334 23978 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46875
I20260805 23:00:12.277724 23978 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:12.278591 23978 heartbeater.cc:511] Master 127.22.45.126:46875 requested a full tablet report, sending...
I20260805 23:00:12.280390 23520 ts_manager.cc:194] Registered new tserver with Master: 14a543c467324f159cf800336bb3b830 (127.22.45.66:46697)
I20260805 23:00:12.281352 23520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:32893
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:12.303469 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46875
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33769
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:12.668608 23988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:12.668962 23988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:12.669083 23988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:12.678025 23988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:12.678182 23988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:12.678309 23988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:12.689751 23988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33769
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46875
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:12.691287 23988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:12.692739 23988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:12.707839 23997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:12.707798 23995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:12.707890 24002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:12.709123 23988 server_base.cc:1034] running on GCE node
I20260805 23:00:12.709854 23988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:12.711086 23988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:12.712370 23988 hybrid_clock.cc:648] HybridClock initialized: now 1785970812712311 us; error 58 us; skew 500 ppm
I20260805 23:00:12.712774 23988 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:12 dist-test-slave-1vmg krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970812, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:12.716506 23988 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:12.718369 23988 webserver.cc:460] Webserver started at http://127.22.45.67:44793/ using document root <none> and password file <none>
I20260805 23:00:12.719287 23988 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:12.719419 23988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:12.719772 23988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:12.723323 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "85e156107bb343d68799b28d35c2ea39"
format_stamp: "Formatted at 2026-08-05 23:00:12 on dist-test-slave-1vmg"
server_key: "6017fa011270ca3a4fab41c68c304981"
server_key_iv: "3f09a5efca3df934ea927af716a5ce8c"
server_key_version: "encryptionkey@0"
I20260805 23:00:12.723825 23795 heartbeater.cc:503] Master 127.22.45.126:46875 was elected leader, sending a full tablet report...
I20260805 23:00:12.724347 23988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "85e156107bb343d68799b28d35c2ea39"
format_stamp: "Formatted at 2026-08-05 23:00:12 on dist-test-slave-1vmg"
server_key: "6017fa011270ca3a4fab41c68c304981"
server_key_iv: "3f09a5efca3df934ea927af716a5ce8c"
server_key_version: "encryptionkey@0"
I20260805 23:00:12.730620 23988 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:12.734719 24012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:12.736240 23988 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:12.736438 23988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "85e156107bb343d68799b28d35c2ea39"
format_stamp: "Formatted at 2026-08-05 23:00:12 on dist-test-slave-1vmg"
server_key: "6017fa011270ca3a4fab41c68c304981"
server_key_iv: "3f09a5efca3df934ea927af716a5ce8c"
server_key_version: "encryptionkey@0"
I20260805 23:00:12.736663 23988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:12.761526 23988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:12.766671 23988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:12.767071 23988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:12.768288 23988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:12.770148 23988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:12.770278 23988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:12.770426 23988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:12.770483 23988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:12.805375 23988 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:38215
I20260805 23:00:12.805426 24173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:38215 every 8 connection(s)
I20260805 23:00:12.807214 23988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:12.817548 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 23988
I20260805 23:00:12.817811 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:12.818382 22709 external_mini_cluster.cc:1428] Setting key 4a3dd02b385ae01065816beca61a63ab
Aug 05 23:00:12 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970812, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:12.830701 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.810226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:40193 (local address 127.22.45.126:46875)
0805 23:00:12.810726 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:12.810733 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:12.812030 (+ 1297us) server_negotiation.cc:407] Connection header received
0805 23:00:12.814150 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:12.814156 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:12.814264 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:12.814377 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:12.816561 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.817473 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.819891 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.820375 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.820492 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.824739 (+ 4247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:12.824745 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:12.824749 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:12.824788 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:12.827581 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:12.828473 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:12.828477 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:12.828479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:12.828618 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:12.829047 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:12.829051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:12.829053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:12.829352 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:12.829488 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:12.830213 (+ 725us) server_negotiation.cc:299] Negotiation successful
0805 23:00:12.830406 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":222,"threads_started":1}
I20260805 23:00:12.831774 24178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.810961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46875 (local address 127.22.45.67:40193)
0805 23:00:12.811811 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:12.811862 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:12.813734 (+ 1872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:12.814651 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:12.814661 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:12.815380 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:12.816264 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.816295 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.817738 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.817745 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.819668 (+ 1923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.819690 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.820620 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.820626 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.820952 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.821861 (+ 909us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:12.821896 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:12.824434 (+ 2538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:12.827769 (+ 3335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:12.827778 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:12.827808 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:12.828343 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:12.828703 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:12.828706 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:12.828708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:12.828917 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:12.829458 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:12.829465 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:12.829833 (+ 368us) client_negotiation.cc:769] Sending connection context
0805 23:00:12.830078 (+ 245us) client_negotiation.cc:240] Negotiation successful
0805 23:00:12.830523 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":314,"threads_started":1}
I20260805 23:00:12.833401 24175 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46875
I20260805 23:00:12.833724 24175 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:12.834460 24175 heartbeater.cc:511] Master 127.22.45.126:46875 requested a full tablet report, sending...
I20260805 23:00:12.835968 23520 ts_manager.cc:194] Registered new tserver with Master: 85e156107bb343d68799b28d35c2ea39 (127.22.45.67:38215)
I20260805 23:00:12.836790 23520 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:40193
I20260805 23:00:12.847244 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:00:12.869608 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.854208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44862 (local address 127.22.45.126:46875)
0805 23:00:12.854446 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:12.854452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:12.854890 (+ 438us) server_negotiation.cc:407] Connection header received
0805 23:00:12.855122 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:12.855127 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:12.855201 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:12.855301 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:12.857159 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.857936 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.859454 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.859938 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.860067 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.863030 (+ 2963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:12.863038 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:12.863042 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:12.863095 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:12.866036 (+ 2941us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:12.867159 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:12.867165 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:12.867167 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:12.867349 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:12.867914 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:12.867918 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:12.867921 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:12.868384 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:12.868609 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:12.869064 (+ 455us) server_negotiation.cc:299] Negotiation successful
0805 23:00:12.869330 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260805 23:00:12.877665 23520 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44862:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:12.885174 23520 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:12.912323 24191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.899934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:38215 (local address 127.0.0.1:37480)
0805 23:00:12.901950 (+ 2016us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:12.901972 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:12.902136 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:12.904426 (+ 2290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:12.904431 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:12.904457 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:12.904985 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.905000 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.907163 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.907168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.909440 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.909454 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.911375 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.911382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.911610 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.911669 (+ 59us) client_negotiation.cc:769] Sending connection context
0805 23:00:12.911807 (+ 138us) client_negotiation.cc:240] Negotiation successful
0805 23:00:12.911975 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1873,"mutex_wait_us":30,"thread_start_us":2445,"threads_started":1}
I20260805 23:00:12.912333 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.900665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37480 (local address 127.22.45.67:38215)
0805 23:00:12.903822 (+ 3157us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:12.903831 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:12.903866 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:00:12.903967 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:12.903973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:12.904191 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:12.905191 (+ 1000us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:12.905514 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.906999 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.909652 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.911119 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.911269 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.911553 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:12.911871 (+ 318us) server_negotiation.cc:299] Negotiation successful
0805 23:00:12.912039 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2977,"thread_start_us":2793,"threads_started":1}
I20260805 23:00:12.913508 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.899861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43635 (local address 127.0.0.1:53848)
0805 23:00:12.901085 (+ 1224us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:12.901132 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:12.901352 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:12.905584 (+ 4232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:12.905589 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:12.905617 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:12.905971 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.905983 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.907803 (+ 1820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.907807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.909878 (+ 2071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.909891 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.912600 (+ 2709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.912610 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.912790 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.912825 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:00:12.912926 (+ 101us) client_negotiation.cc:240] Negotiation successful
0805 23:00:12.913063 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":841,"mutex_wait_us":67,"thread_start_us":666,"threads_started":1}
I20260805 23:00:12.913818 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.899842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53848 (local address 127.22.45.65:43635)
0805 23:00:12.904929 (+ 5087us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:12.904938 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:12.904969 (+ 31us) server_negotiation.cc:407] Connection header received
0805 23:00:12.905067 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:12.905075 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:12.905312 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:12.905569 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:12.906184 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.907642 (+ 1458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.910060 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.911131 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.911386 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.911625 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:12.913016 (+ 1391us) server_negotiation.cc:299] Negotiation successful
0805 23:00:12.913215 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4895,"thread_start_us":4010,"threads_started":1}
I20260805 23:00:12.914676 24194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.901565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:46697 (local address 127.0.0.1:49890)
0805 23:00:12.902643 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:12.902664 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:12.902769 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:12.904171 (+ 1402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:12.904179 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:12.904211 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:12.904648 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.904662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.906528 (+ 1866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.906533 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.909187 (+ 2654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:12.909205 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.913946 (+ 4741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.913953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:12.914156 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.914189 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:00:12.914295 (+ 106us) client_negotiation.cc:240] Negotiation successful
0805 23:00:12.914407 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":944,"mutex_wait_us":69,"thread_start_us":1035,"threads_started":1}
I20260805 23:00:12.915452 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:12.902156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49890 (local address 127.22.45.66:46697)
0805 23:00:12.903350 (+ 1194us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:12.903361 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:12.903398 (+ 37us) server_negotiation.cc:407] Connection header received
0805 23:00:12.903530 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:12.903540 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:12.903859 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:12.904171 (+ 312us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:12.904902 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.906401 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.909434 (+ 3033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:12.911119 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:12.911269 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:12.911498 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:12.914507 (+ 3009us) server_negotiation.cc:299] Negotiation successful
0805 23:00:12.914964 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1005,"thread_start_us":841,"threads_started":1}
I20260805 23:00:12.917677 24080 tablet_service.cc:1467] Processing CreateTablet for tablet 37c179cd79fa482ba9bf6c0ca562ea37 (DEFAULT_TABLE table=test-table [id=fbeb8ff25701453d9df6596e2f4a1835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:12.918421 23696 tablet_service.cc:1467] Processing CreateTablet for tablet 37c179cd79fa482ba9bf6c0ca562ea37 (DEFAULT_TABLE table=test-table [id=fbeb8ff25701453d9df6596e2f4a1835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:12.919327 24080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37c179cd79fa482ba9bf6c0ca562ea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:12.919374 23892 tablet_service.cc:1467] Processing CreateTablet for tablet 37c179cd79fa482ba9bf6c0ca562ea37 (DEFAULT_TABLE table=test-table [id=fbeb8ff25701453d9df6596e2f4a1835]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:12.920104 23696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37c179cd79fa482ba9bf6c0ca562ea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:12.920876 23892 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37c179cd79fa482ba9bf6c0ca562ea37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:12.932116 24197 tablet_bootstrap.cc:492] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39: Bootstrap starting.
I20260805 23:00:12.935891 24198 tablet_bootstrap.cc:492] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830: Bootstrap starting.
I20260805 23:00:12.937940 24199 tablet_bootstrap.cc:492] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934: Bootstrap starting.
I20260805 23:00:12.938156 24197 tablet_bootstrap.cc:654] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:12.939839 24197 log.cc:824] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:12.940313 24198 tablet_bootstrap.cc:654] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:12.941351 24199 tablet_bootstrap.cc:654] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:12.942414 24199 log.cc:824] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:12.942835 24198 log.cc:824] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:12.949779 24197 tablet_bootstrap.cc:492] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39: No bootstrap required, opened a new log
I20260805 23:00:12.949898 24198 tablet_bootstrap.cc:492] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830: No bootstrap required, opened a new log
I20260805 23:00:12.950201 24197 ts_tablet_manager.cc:1397] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39: Time spent bootstrapping tablet: real 0.018s user 0.015s sys 0.000s
I20260805 23:00:12.950287 24198 ts_tablet_manager.cc:1397] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260805 23:00:12.950393 24199 tablet_bootstrap.cc:492] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934: No bootstrap required, opened a new log
I20260805 23:00:12.950675 24199 ts_tablet_manager.cc:1397] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260805 23:00:12.958602 24197 raft_consensus.cc:348] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:12.959142 24197 raft_consensus.cc:374] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:12.959265 24197 raft_consensus.cc:729] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85e156107bb343d68799b28d35c2ea39, State: Initialized, Role: FOLLOWER
I20260805 23:00:12.959968 24197 consensus_queue.cc:260] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:12.961189 24175 heartbeater.cc:503] Master 127.22.45.126:46875 was elected leader, sending a full tablet report...
I20260805 23:00:12.961159 24198 raft_consensus.cc:348] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:12.961159 24199 raft_consensus.cc:348] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:12.961616 24198 raft_consensus.cc:374] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:12.961616 24199 raft_consensus.cc:374] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:12.961716 24199 raft_consensus.cc:729] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05f57d9020ed46e5b5c8f6546ce8c934, State: Initialized, Role: FOLLOWER
I20260805 23:00:12.961725 24198 raft_consensus.cc:729] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14a543c467324f159cf800336bb3b830, State: Initialized, Role: FOLLOWER
I20260805 23:00:12.961970 24197 ts_tablet_manager.cc:1428] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260805 23:00:12.962463 24198 consensus_queue.cc:260] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:12.962463 24199 consensus_queue.cc:260] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:12.964512 24199 ts_tablet_manager.cc:1428] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934: Time spent starting tablet: real 0.014s user 0.013s sys 0.002s
I20260805 23:00:12.968277 23978 heartbeater.cc:503] Master 127.22.45.126:46875 was elected leader, sending a full tablet report...
I20260805 23:00:12.968354 24198 ts_tablet_manager.cc:1428] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830: Time spent starting tablet: real 0.018s user 0.012s sys 0.004s
W20260805 23:00:12.998675 23979 tablet.cc:2369] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:00:13.059154 24176 tablet.cc:2369] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:00:13.103715 24208 raft_consensus.cc:482] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:13.104120 24208 raft_consensus.cc:504] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:13.106226 24208 leader_election.cc:288] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 85e156107bb343d68799b28d35c2ea39 (127.22.45.67:38215), 14a543c467324f159cf800336bb3b830 (127.22.45.66:46697)
I20260805 23:00:13.113996 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.107084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:44477 (local address 127.22.45.66:46697)
0805 23:00:13.107430 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.107437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.108194 (+ 757us) server_negotiation.cc:407] Connection header received
0805 23:00:13.108373 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.108377 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.108443 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.108528 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:13.109176 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.109975 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.112098 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.112966 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.113155 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.113276 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.113571 (+ 295us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.113727 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260805 23:00:13.114169 24211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.106821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:46697 (local address 127.22.45.65:44477)
0805 23:00:13.108056 (+ 1235us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:13.108073 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:13.108233 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:13.108569 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:13.108573 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:13.108601 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:13.108973 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:13.108985 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.110149 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.110154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:13.111874 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:13.111896 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.113204 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.113212 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:13.113393 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.113421 (+ 28us) client_negotiation.cc:769] Sending connection context
0805 23:00:13.113515 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 23:00:13.113677 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1122,"mutex_wait_us":1,"spinlock_wait_cycles":33152,"thread_start_us":839,"threads_started":1}
I20260805 23:00:13.115053 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.106901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:48333 (local address 127.22.45.67:38215)
0805 23:00:13.107178 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.107185 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.108141 (+ 956us) server_negotiation.cc:407] Connection header received
0805 23:00:13.108355 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.108359 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.108427 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.108816 (+ 389us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:13.109764 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.110737 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.112988 (+ 2251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.113911 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.114087 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.114167 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.114613 (+ 446us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.114773 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260805 23:00:13.115085 24210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.106790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:38215 (local address 127.22.45.65:48333)
0805 23:00:13.107974 (+ 1184us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:13.107994 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:13.108198 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:13.108883 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:13.108893 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:13.108944 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:13.109521 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:13.109540 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.110984 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.110989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:13.112721 (+ 1732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:13.112736 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.114194 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.114202 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:13.114387 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.114422 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:00:13.114570 (+ 148us) client_negotiation.cc:240] Negotiation successful
0805 23:00:13.114721 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1013,"thread_start_us":719,"threads_started":1}
I20260805 23:00:13.115465 23919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37c179cd79fa482ba9bf6c0ca562ea37" candidate_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14a543c467324f159cf800336bb3b830" is_pre_election: true
I20260805 23:00:13.116034 23919 raft_consensus.cc:2454] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f57d9020ed46e5b5c8f6546ce8c934 in term 0.
I20260805 23:00:13.116155 24104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37c179cd79fa482ba9bf6c0ca562ea37" candidate_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e156107bb343d68799b28d35c2ea39" is_pre_election: true
I20260805 23:00:13.116704 24104 raft_consensus.cc:2454] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05f57d9020ed46e5b5c8f6546ce8c934 in term 0.
I20260805 23:00:13.116801 23632 leader_election.cc:302] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05f57d9020ed46e5b5c8f6546ce8c934, 14a543c467324f159cf800336bb3b830; no voters:
I20260805 23:00:13.117280 24208 raft_consensus.cc:2781] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:13.117411 24208 raft_consensus.cc:482] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:13.117527 24208 raft_consensus.cc:3037] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:13.120114 24208 raft_consensus.cc:504] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:13.120883 24208 leader_election.cc:288] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [CANDIDATE]: Term 1 election: Requested vote from peers 85e156107bb343d68799b28d35c2ea39 (127.22.45.67:38215), 14a543c467324f159cf800336bb3b830 (127.22.45.66:46697)
I20260805 23:00:13.121556 23919 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37c179cd79fa482ba9bf6c0ca562ea37" candidate_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14a543c467324f159cf800336bb3b830"
I20260805 23:00:13.121580 24104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37c179cd79fa482ba9bf6c0ca562ea37" candidate_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85e156107bb343d68799b28d35c2ea39"
I20260805 23:00:13.121800 24104 raft_consensus.cc:3037] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:13.121824 23919 raft_consensus.cc:3037] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:13.124702 24104 raft_consensus.cc:2454] T 37c179cd79fa482ba9bf6c0ca562ea37 P 85e156107bb343d68799b28d35c2ea39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f57d9020ed46e5b5c8f6546ce8c934 in term 1.
I20260805 23:00:13.124780 23919 raft_consensus.cc:2454] T 37c179cd79fa482ba9bf6c0ca562ea37 P 14a543c467324f159cf800336bb3b830 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05f57d9020ed46e5b5c8f6546ce8c934 in term 1.
I20260805 23:00:13.125383 23632 leader_election.cc:302] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 05f57d9020ed46e5b5c8f6546ce8c934, 14a543c467324f159cf800336bb3b830, 85e156107bb343d68799b28d35c2ea39; no voters:
I20260805 23:00:13.125782 24208 raft_consensus.cc:2781] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:13.126286 24208 raft_consensus.cc:686] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [term 1 LEADER]: Becoming Leader. State: Replica: 05f57d9020ed46e5b5c8f6546ce8c934, State: Running, Role: LEADER
I20260805 23:00:13.126883 24208 consensus_queue.cc:237] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } }
I20260805 23:00:13.132313 23518 catalog_manager.cc:5495] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934 reported cstate change: term changed from 0 to 1, leader changed from <none> to 05f57d9020ed46e5b5c8f6546ce8c934 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "05f57d9020ed46e5b5c8f6546ce8c934" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85e156107bb343d68799b28d35c2ea39" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14a543c467324f159cf800336bb3b830" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 46697 } health_report { overall_health: UNKNOWN } } }
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970810, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:13.165628 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.147053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53850 (local address 127.22.45.65:43635)
0805 23:00:13.147312 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.147318 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.147803 (+ 485us) server_negotiation.cc:407] Connection header received
0805 23:00:13.147921 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.147925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.147998 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.148089 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:13.149958 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.150821 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.152402 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.152866 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.153102 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.158172 (+ 5070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:13.158191 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:13.158210 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:13.158263 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:13.161603 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.162515 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.162524 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.162526 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.162743 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.163221 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.163227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.163229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.163971 (+ 742us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:13.164579 (+ 608us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.165001 (+ 422us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.165294 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260805 23:00:13.189663 23796 tablet.cc:2369] T 37c179cd79fa482ba9bf6c0ca562ea37 P 05f57d9020ed46e5b5c8f6546ce8c934: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970813, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970813, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:13.228029 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.211389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53854 (local address 127.22.45.65:43635)
0805 23:00:13.211676 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.211683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.211890 (+ 207us) server_negotiation.cc:407] Connection header received
0805 23:00:13.212112 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.212117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.212187 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.212280 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:13.213863 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.214643 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.216042 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.216500 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.216630 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.221587 (+ 4957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:13.221594 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:13.221597 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:13.221649 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:13.224863 (+ 3214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.225803 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.225807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.225810 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.225977 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.226498 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.226502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.226504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.226856 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:13.227213 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.227516 (+ 303us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.227750 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[23455](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:13.296443 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.275995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53870 (local address 127.22.45.65:43635)
0805 23:00:13.276389 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.276398 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.276855 (+ 457us) server_negotiation.cc:407] Connection header received
0805 23:00:13.277261 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.277267 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.277385 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.277487 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:13.279488 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.280390 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.281933 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.282556 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.282676 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.288291 (+ 5615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:13.288300 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:13.288304 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:13.288377 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:13.292275 (+ 3898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.293458 (+ 1183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.293464 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.293467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.293861 (+ 394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.294416 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.294422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.294425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.294879 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:13.295373 (+ 494us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.295870 (+ 497us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.296117 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
W20260805 23:00:13.298709 23667 tablet_service.cc:2908] Rejecting scan request for tablet 37c179cd79fa482ba9bf6c0ca562ea37: Uninitialized: clean time has not yet been initialized
I20260805 23:00:13.302726 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 23604
I20260805 23:00:13.317356 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.303976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53886 (local address 127.22.45.65:43635)
0805 23:00:13.304184 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.304191 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.304490 (+ 299us) server_negotiation.cc:407] Connection header received
0805 23:00:13.304696 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.304702 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.304772 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.304868 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:13.306173 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.306908 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.308297 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.308728 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.308844 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.311833 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:13.311839 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:13.311842 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:13.311882 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:13.314590 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.315487 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.315491 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.315494 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.315664 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.316048 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.316051 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.316054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.316389 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:13.316597 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.316852 (+ 255us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.317085 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 23:00:13.318114 23788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:13.415450 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 23604
I20260805 23:00:13.437918 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 23802
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:13.454695 24196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.438872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49892 (local address 127.22.45.66:46697)
0805 23:00:13.439094 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.439099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.439121 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:00:13.439297 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.439301 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.439370 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.439473 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:13.440836 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.441679 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.443128 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.443559 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.443684 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.448396 (+ 4712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:13.448415 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:13.448433 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:13.448478 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:13.451549 (+ 3071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.452431 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.452440 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.452442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.452603 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.453006 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.453010 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.453012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.453450 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:13.453770 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.454085 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.454333 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260805 23:00:13.455677 23971 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:13.546595 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 23802
I20260805 23:00:13.571326 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 23988
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[23455](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970813, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:13.587795 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:13.572119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37492 (local address 127.22.45.67:38215)
0805 23:00:13.572315 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:13.572321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:13.572342 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:00:13.572452 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:13.572458 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:13.572552 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:13.572641 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:13.573940 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.574674 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.576404 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:13.576820 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:13.576978 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:13.581628 (+ 4650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:13.581648 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:13.581666 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:13.581710 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:13.584681 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.585526 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.585534 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.585537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.585716 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:13.586110 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:13.586115 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:13.586117 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:13.586514 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:13.586822 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:13.587190 (+ 368us) server_negotiation.cc:299] Negotiation successful
0805 23:00:13.587414 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 23:00:13.588454 24169 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:13.678251 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 23988
I20260805 23:00:13.700484 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 23476
I20260805 23:00:13.701864 23564 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:13.817286 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 23476
2026-08-05T23:00:13Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4671 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[24239](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[24239](info): set up 2 sockets
Aug 05 23:00:13 dist-test-slave-1vmg krb5kdc[24239](info): commencing operation
krb5kdc: starting...
W20260805 23:00:15.016925 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.005s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:15 dist-test-slave-1vmg krb5kdc[24239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:15.239279 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38851
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:38851
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:15.602491 24254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:15.602886 24254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:15.603040 24254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:15.610993 24254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:15.611146 24254 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 23:00:15.611230 24254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:15.611321 24254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:15.611395 24254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:15.611492 24254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:15.622882 24254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:38851
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:15.624497 24254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:15.626055 24254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:15.639575 24263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:15.639528 24266 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:15.639561 24264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:15.640576 24254 server_base.cc:1034] running on GCE node
I20260805 23:00:15.641439 24254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:15.643101 24254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:15.644341 24254 hybrid_clock.cc:648] HybridClock initialized: now 1785970815644269 us; error 42 us; skew 500 ppm
I20260805 23:00:15.644724 24254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:15 dist-test-slave-1vmg krb5kdc[24239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970815, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:15.648880 24254 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:15.651017 24254 webserver.cc:460] Webserver started at http://127.22.45.126:45859/ using document root <none> and password file <none>
I20260805 23:00:15.651878 24254 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:15.651991 24254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:15.652333 24254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:15.655905 24254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "c457582d6f3c46b1a52a49d4d1c4d55d"
format_stamp: "Formatted at 2026-08-05 23:00:15 on dist-test-slave-1vmg"
server_key: "618ba1b302f0933212753ad8de060e00"
server_key_iv: "6556b37c17b5a1a956eb39624989a5b9"
server_key_version: "encryptionkey@0"
I20260805 23:00:15.656847 24254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "c457582d6f3c46b1a52a49d4d1c4d55d"
format_stamp: "Formatted at 2026-08-05 23:00:15 on dist-test-slave-1vmg"
server_key: "618ba1b302f0933212753ad8de060e00"
server_key_iv: "6556b37c17b5a1a956eb39624989a5b9"
server_key_version: "encryptionkey@0"
I20260805 23:00:15.663640 24254 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:00:15.668385 24276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:15.670578 24254 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:00:15.670836 24254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "c457582d6f3c46b1a52a49d4d1c4d55d"
format_stamp: "Formatted at 2026-08-05 23:00:15 on dist-test-slave-1vmg"
server_key: "618ba1b302f0933212753ad8de060e00"
server_key_iv: "6556b37c17b5a1a956eb39624989a5b9"
server_key_version: "encryptionkey@0"
I20260805 23:00:15.671236 24254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:15.690565 24254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:15.695770 24254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:15.696069 24254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:15.719553 24254 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:38851
I20260805 23:00:15.719564 24372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:38851 every 8 connection(s)
I20260805 23:00:15.721207 24254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:15.722715 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 24254
I20260805 23:00:15.723006 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:15.723872 22709 external_mini_cluster.cc:1428] Setting key 4ba18b9928dab918385f10f2f42c242a
I20260805 23:00:15.726717 24373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:00:15 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970815, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:15.742354 24373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d: Bootstrap starting.
I20260805 23:00:15.746362 24373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:15.747886 24373 log.cc:824] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:15.751489 24378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:15.726246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46886 (local address 127.22.45.126:38851)
0805 23:00:15.727164 (+ 918us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:15.727177 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:15.727222 (+ 45us) server_negotiation.cc:407] Connection header received
0805 23:00:15.728964 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:15.728990 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:15.729469 (+ 479us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:15.729876 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:15.731910 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:15.733439 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:15.736074 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:15.736872 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:15.737050 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:15.742684 (+ 5634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:15.742700 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:15.742727 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:15.742790 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:15.746242 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:15.747423 (+ 1181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:15.747433 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:15.747441 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:15.747687 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:15.748192 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:15.748196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:15.748199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:15.749076 (+ 877us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:15.749453 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:15.749845 (+ 392us) server_negotiation.cc:299] Negotiation successful
0805 23:00:15.750302 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":397,"threads_started":1}
I20260805 23:00:15.751775 24373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d: No bootstrap required, opened a new log
I20260805 23:00:15.759856 24373 raft_consensus.cc:348] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38851 } }
I20260805 23:00:15.760362 24373 raft_consensus.cc:374] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:15.760530 24373 raft_consensus.cc:729] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c457582d6f3c46b1a52a49d4d1c4d55d, State: Initialized, Role: FOLLOWER
I20260805 23:00:15.761184 24373 consensus_queue.cc:260] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38851 } }
I20260805 23:00:15.761433 24373 raft_consensus.cc:388] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:15.761570 24373 raft_consensus.cc:482] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:15.761739 24373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:15.764263 24373 raft_consensus.cc:504] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38851 } }
I20260805 23:00:15.764923 24373 leader_election.cc:302] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c457582d6f3c46b1a52a49d4d1c4d55d; no voters:
I20260805 23:00:15.765578 24373 leader_election.cc:288] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:15.765715 24380 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:15.766417 24380 raft_consensus.cc:686] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [term 1 LEADER]: Becoming Leader. State: Replica: c457582d6f3c46b1a52a49d4d1c4d55d, State: Running, Role: LEADER
I20260805 23:00:15.767059 24380 consensus_queue.cc:237] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38851 } }
I20260805 23:00:15.767940 24373 sys_catalog.cc:564] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:15.770105 24381 sys_catalog.cc:455] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38851 } } }
I20260805 23:00:15.770187 24385 sys_catalog.cc:455] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c457582d6f3c46b1a52a49d4d1c4d55d. Latest consensus state: current_term: 1 leader_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c457582d6f3c46b1a52a49d4d1c4d55d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38851 } } }
I20260805 23:00:15.770714 24381 sys_catalog.cc:458] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:15.770821 24385 sys_catalog.cc:458] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:15.773052 24398 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:15.778623 24398 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:15.788266 24398 catalog_manager.cc:1347] Generated new cluster ID: d8250ac2723b4694bed1bac545c84327
I20260805 23:00:15.788406 24398 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:15.809556 24398 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:15.811094 24398 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:15.818655 24398 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d: Generated new TSK 0
I20260805 23:00:15.820001 24398 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:15.887257 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38851
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:16.245105 24413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:16.245445 24413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:16.245585 24413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:16.253553 24413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:16.253695 24413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:16.253811 24413 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:00:16.253919 24413 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:16.264673 24413 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:16.266207 24413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:16.267808 24413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:16.282289 24420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:16.282243 24422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:16.283131 24425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:16.283408 24413 server_base.cc:1034] running on GCE node
I20260805 23:00:16.284180 24413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:16.285285 24413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:16.286540 24413 hybrid_clock.cc:648] HybridClock initialized: now 1785970816286455 us; error 70 us; skew 500 ppm
I20260805 23:00:16.286862 24413 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:16 dist-test-slave-1vmg krb5kdc[24239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:16.295084 24413 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:16.296871 24413 webserver.cc:460] Webserver started at http://127.22.45.65:38761/ using document root <none> and password file <none>
I20260805 23:00:16.297660 24413 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:16.297768 24413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:16.298116 24413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:16.301585 24413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "0943f8718a414c40a963de506a132aa9"
format_stamp: "Formatted at 2026-08-05 23:00:16 on dist-test-slave-1vmg"
server_key: "b13c93a339f9666cd365e6c67c0dd922"
server_key_iv: "6ddd6568247f98cd0733784da542602e"
server_key_version: "encryptionkey@0"
I20260805 23:00:16.302533 24413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "0943f8718a414c40a963de506a132aa9"
format_stamp: "Formatted at 2026-08-05 23:00:16 on dist-test-slave-1vmg"
server_key: "b13c93a339f9666cd365e6c67c0dd922"
server_key_iv: "6ddd6568247f98cd0733784da542602e"
server_key_version: "encryptionkey@0"
I20260805 23:00:16.308495 24413 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:00:16.312515 24434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:16.314107 24413 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:00:16.314323 24413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "0943f8718a414c40a963de506a132aa9"
format_stamp: "Formatted at 2026-08-05 23:00:16 on dist-test-slave-1vmg"
server_key: "b13c93a339f9666cd365e6c67c0dd922"
server_key_iv: "6ddd6568247f98cd0733784da542602e"
server_key_version: "encryptionkey@0"
I20260805 23:00:16.314576 24413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:16.360335 24413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:16.365238 24413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:16.365556 24413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:16.368758 24413 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:16.368872 24413 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:16.369030 24413 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:16.369099 24413 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:00:16 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:16.394960 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.369426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:43145 (local address 127.22.45.126:38851)
0805 23:00:16.371182 (+ 1756us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:16.371189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:16.371907 (+ 718us) server_negotiation.cc:407] Connection header received
0805 23:00:16.374557 (+ 2650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:16.374563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:16.374669 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:16.374799 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:16.377863 (+ 3064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.378833 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.380728 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.381191 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.381319 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.386977 (+ 5658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:16.386987 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:16.386992 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:16.387046 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:16.390302 (+ 3256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.391904 (+ 1602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.391911 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.391914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.392111 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.392792 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.392797 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.392801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.393210 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:16.393376 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:16.394268 (+ 892us) server_negotiation.cc:299] Negotiation successful
0805 23:00:16.394558 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1615,"thread_start_us":1496,"threads_started":1}
I20260805 23:00:16.396242 24447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.370375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38851 (local address 127.22.45.65:43145)
0805 23:00:16.371707 (+ 1332us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:16.371766 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:16.374222 (+ 2456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:16.375256 (+ 1034us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:16.375269 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:16.376358 (+ 1089us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:16.377554 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.377595 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.379064 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.379069 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.380537 (+ 1468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.380554 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.381557 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.381568 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.381783 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.382594 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:16.382634 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:16.386528 (+ 3894us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:16.390538 (+ 4010us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.390556 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.390585 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.391653 (+ 1068us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.392257 (+ 604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.392263 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.392266 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.392648 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.393380 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:16.393390 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:16.393828 (+ 438us) client_negotiation.cc:769] Sending connection context
0805 23:00:16.394113 (+ 285us) client_negotiation.cc:240] Negotiation successful
0805 23:00:16.394722 (+ 609us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":979,"thread_start_us":705,"threads_started":1}
I20260805 23:00:16.417676 24413 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:39445
I20260805 23:00:16.417678 24615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:39445 every 8 connection(s)
I20260805 23:00:16.419559 24413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:16.421182 24567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.404091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38851 (local address 127.22.45.65:49211)
0805 23:00:16.404759 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:16.404783 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:16.404991 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:16.405456 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:16.405461 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:16.406286 (+ 825us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:16.406625 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.406637 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.408291 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.408298 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.409596 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.409621 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.410874 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.410881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.411149 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.412079 (+ 930us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:16.412110 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:16.413565 (+ 1455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:16.417922 (+ 4357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.417927 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.417929 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.418392 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.418948 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.418954 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.418958 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.419106 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.419873 (+ 767us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:16.419877 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:16.420079 (+ 202us) client_negotiation.cc:769] Sending connection context
0805 23:00:16.420259 (+ 180us) client_negotiation.cc:240] Negotiation successful
0805 23:00:16.420691 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":338,"threads_started":1}
I20260805 23:00:16.422088 24616 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38851
I20260805 23:00:16.422348 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 24413
I20260805 23:00:16.422465 24616 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:16.422592 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:16.423401 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.404064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:49211 (local address 127.22.45.126:38851)
0805 23:00:16.404310 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:16.404318 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:16.404896 (+ 578us) server_negotiation.cc:407] Connection header received
0805 23:00:16.405166 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:16.405173 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:16.405274 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:16.405400 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:16.406834 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.408052 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.409844 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.410575 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.410734 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.413903 (+ 3169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:16.413913 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:16.413919 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:16.413968 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:16.417749 (+ 3781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.418555 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.418561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.418565 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.418770 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.419244 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.419249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.419252 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.419667 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:16.419916 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:16.421726 (+ 1810us) server_negotiation.cc:299] Negotiation successful
0805 23:00:16.423153 (+ 1427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 23:00:16.423411 24616 heartbeater.cc:511] Master 127.22.45.126:38851 requested a full tablet report, sending...
I20260805 23:00:16.423448 22709 external_mini_cluster.cc:1428] Setting key 9b16b98913d34c46f94fccec5627f308
I20260805 23:00:16.425853 24307 ts_manager.cc:194] Registered new tserver with Master: 0943f8718a414c40a963de506a132aa9 (127.22.45.65:39445)
I20260805 23:00:16.427982 24307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:43145
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:16.468768 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38851
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:16.835340 24623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:16.835698 24623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:16.835850 24623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:16.843709 24623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:16.843881 24623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:16.844008 24623 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:00:16.844125 24623 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:16.854605 24623 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:16.856113 24623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:16.857580 24623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:16.871640 24632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:16.871707 24636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:16.871732 24634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:16.872856 24623 server_base.cc:1034] running on GCE node
I20260805 23:00:16.873616 24623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:16.874783 24623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:16.876056 24623 hybrid_clock.cc:648] HybridClock initialized: now 1785970816875954 us; error 68 us; skew 500 ppm
I20260805 23:00:16.876412 24623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:16 dist-test-slave-1vmg krb5kdc[24239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:16.880095 24623 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:16.881719 24623 webserver.cc:460] Webserver started at http://127.22.45.66:37139/ using document root <none> and password file <none>
I20260805 23:00:16.882542 24623 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:16.882673 24623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:16.883088 24623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:16.886426 24623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "e635471dfe704d90ac2f75ff700607da"
format_stamp: "Formatted at 2026-08-05 23:00:16 on dist-test-slave-1vmg"
server_key: "12ca072becb4552887615080008f51f0"
server_key_iv: "4a8a5408b4a0011b817b28fc0da218ea"
server_key_version: "encryptionkey@0"
I20260805 23:00:16.887432 24623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "e635471dfe704d90ac2f75ff700607da"
format_stamp: "Formatted at 2026-08-05 23:00:16 on dist-test-slave-1vmg"
server_key: "12ca072becb4552887615080008f51f0"
server_key_iv: "4a8a5408b4a0011b817b28fc0da218ea"
server_key_version: "encryptionkey@0"
I20260805 23:00:16.893189 24623 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 23:00:16.897388 24652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:16.899251 24623 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:00:16.899447 24623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "e635471dfe704d90ac2f75ff700607da"
format_stamp: "Formatted at 2026-08-05 23:00:16 on dist-test-slave-1vmg"
server_key: "12ca072becb4552887615080008f51f0"
server_key_iv: "4a8a5408b4a0011b817b28fc0da218ea"
server_key_version: "encryptionkey@0"
I20260805 23:00:16.899688 24623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:16.914223 24623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:16.919216 24623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:16.919513 24623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:16.922384 24623 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:16.922484 24623 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:16.922657 24623 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:16.922744 24623 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:00:16 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970816, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:16.950373 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.923469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:33963 (local address 127.22.45.126:38851)
0805 23:00:16.923638 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:16.923642 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:16.925377 (+ 1735us) server_negotiation.cc:407] Connection header received
0805 23:00:16.927805 (+ 2428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:16.927812 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:16.927908 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:16.927969 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:16.930710 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.931807 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.935130 (+ 3323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.935705 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.935870 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.942506 (+ 6636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:16.942514 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:16.942517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:16.942569 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:16.945874 (+ 3305us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.947346 (+ 1472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.947352 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.947355 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.947539 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.948246 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.948251 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.948253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.948607 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:16.948757 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:16.949867 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0805 23:00:16.950101 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 23:00:16.952478 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.924250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38851 (local address 127.22.45.66:33963)
0805 23:00:16.925178 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:16.925236 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:16.927370 (+ 2134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:16.928467 (+ 1097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:16.928482 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:16.929389 (+ 907us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:16.930435 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.930473 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.932044 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.932051 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.934827 (+ 2776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.934877 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.936065 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.936073 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.936465 (+ 392us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.937564 (+ 1099us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:16.937601 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:16.942061 (+ 4460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:16.946138 (+ 4077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.946151 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.946178 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.947116 (+ 938us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.947672 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.947678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.947682 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.948045 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.948755 (+ 710us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:16.948767 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:16.949380 (+ 613us) client_negotiation.cc:769] Sending connection context
0805 23:00:16.949754 (+ 374us) client_negotiation.cc:240] Negotiation successful
0805 23:00:16.950454 (+ 700us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":422,"threads_started":1}
I20260805 23:00:16.973364 24623 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:44855
I20260805 23:00:16.973394 24832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:44855 every 8 connection(s)
I20260805 23:00:16.974773 24623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:16.975339 24445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.959535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:45781 (local address 127.22.45.126:38851)
0805 23:00:16.959788 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:16.959795 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:16.960473 (+ 678us) server_negotiation.cc:407] Connection header received
0805 23:00:16.960803 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:16.960808 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:16.960880 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:16.960984 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:16.962550 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.963358 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.965238 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.965676 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.965805 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.968185 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:16.968193 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:16.968199 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:16.968251 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:16.972085 (+ 3834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.973007 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.973013 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.973017 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.973191 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:16.973659 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:16.973664 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:16.973668 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:16.974058 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:16.974211 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:16.974703 (+ 492us) server_negotiation.cc:299] Negotiation successful
0805 23:00:16.974976 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 23:00:16.975618 24786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:16.959502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38851 (local address 127.22.45.66:45781)
0805 23:00:16.960322 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:16.960352 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:16.960641 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:16.961044 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:16.961049 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:16.961811 (+ 762us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:16.962276 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.962297 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.963522 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.963526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.965062 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:16.965078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:16.965900 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:16.965907 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:16.966071 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:16.966731 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:16.966750 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:16.967868 (+ 1118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:16.972268 (+ 4400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.972273 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.972277 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.972861 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.973307 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:16.973312 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:16.973316 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:16.973511 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:16.974192 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:16.974196 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:16.974393 (+ 197us) client_negotiation.cc:769] Sending connection context
0805 23:00:16.974524 (+ 131us) client_negotiation.cc:240] Negotiation successful
0805 23:00:16.974976 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":541,"threads_started":1}
I20260805 23:00:16.977386 24834 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38851
I20260805 23:00:16.977895 24834 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:16.978713 24834 heartbeater.cc:511] Master 127.22.45.126:38851 requested a full tablet report, sending...
I20260805 23:00:16.980320 24308 ts_manager.cc:194] Registered new tserver with Master: e635471dfe704d90ac2f75ff700607da (127.22.45.66:44855)
I20260805 23:00:16.981196 24308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:33963
I20260805 23:00:16.982390 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 24623
I20260805 23:00:16.982614 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:16.983213 22709 external_mini_cluster.cc:1428] Setting key 38e02d01c69e7f02ad4b7aaa2aa57bda
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:17.027014 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38851
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:17.384003 24840 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:17.384711 24840 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:17.385046 24840 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:17.403235 24840 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:17.403640 24840 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:17.403947 24840 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:00:17.404183 24840 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:17.425611 24840 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:17.428323 24840 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:17.431696 24840 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 23:00:17.431815 24616 heartbeater.cc:503] Master 127.22.45.126:38851 was elected leader, sending a full tablet report...
W20260805 23:00:17.462096 24846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:17.462606 24848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:17.463215 24851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:17.465317 24840 server_base.cc:1034] running on GCE node
I20260805 23:00:17.466892 24840 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:17.469267 24840 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:17.472878 24840 hybrid_clock.cc:648] HybridClock initialized: now 1785970817472652 us; error 101 us; skew 500 ppm
I20260805 23:00:17.473657 24840 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:17 dist-test-slave-1vmg krb5kdc[24239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970817, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:17.483208 24840 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:17.486902 24840 webserver.cc:460] Webserver started at http://127.22.45.67:36439/ using document root <none> and password file <none>
I20260805 23:00:17.488591 24840 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:17.488811 24840 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:17.489527 24840 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:17.496954 24840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "ad555e691a394cc193b69d6d36b6bc38"
format_stamp: "Formatted at 2026-08-05 23:00:17 on dist-test-slave-1vmg"
server_key: "d65df635f511b0e9320b173299691370"
server_key_iv: "1933768dc2437d9e3171cb10e5eaf7ea"
server_key_version: "encryptionkey@0"
I20260805 23:00:17.498843 24840 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "ad555e691a394cc193b69d6d36b6bc38"
format_stamp: "Formatted at 2026-08-05 23:00:17 on dist-test-slave-1vmg"
server_key: "d65df635f511b0e9320b173299691370"
server_key_iv: "1933768dc2437d9e3171cb10e5eaf7ea"
server_key_version: "encryptionkey@0"
I20260805 23:00:17.512137 24840 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.007s sys 0.004s
I20260805 23:00:17.521020 24861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:17.524791 24840 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.005s sys 0.000s
I20260805 23:00:17.525271 24840 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "ad555e691a394cc193b69d6d36b6bc38"
format_stamp: "Formatted at 2026-08-05 23:00:17 on dist-test-slave-1vmg"
server_key: "d65df635f511b0e9320b173299691370"
server_key_iv: "1933768dc2437d9e3171cb10e5eaf7ea"
server_key_version: "encryptionkey@0"
I20260805 23:00:17.525856 24840 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:17.570474 24840 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:17.577239 24840 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:17.577549 24840 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:17.580952 24840 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:17.581095 24840 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:17.581275 24840 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:17.581357 24840 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:00:17 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970817, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:17.613023 24875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.582318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38851 (local address 127.22.45.67:39221)
0805 23:00:17.583361 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:17.583418 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:17.585418 (+ 2000us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:17.586376 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:17.586392 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:17.587931 (+ 1539us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:17.589077 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.589122 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.590764 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.590771 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.594502 (+ 3731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.594536 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.595945 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.595955 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.596353 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.597288 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:17.597323 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:17.600844 (+ 3521us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:17.605539 (+ 4695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:17.605556 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:17.605577 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:17.606374 (+ 797us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:17.607071 (+ 697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:17.607078 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:17.607082 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:17.607436 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:17.608904 (+ 1468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:17.608923 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:17.609786 (+ 863us) client_negotiation.cc:769] Sending connection context
0805 23:00:17.610244 (+ 458us) client_negotiation.cc:240] Negotiation successful
0805 23:00:17.611076 (+ 832us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"thread_start_us":433,"threads_started":1}
I20260805 23:00:17.614496 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.581495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:39221 (local address 127.22.45.126:38851)
0805 23:00:17.582319 (+ 824us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.582324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.583558 (+ 1234us) server_negotiation.cc:407] Connection header received
0805 23:00:17.585776 (+ 2218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.585783 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.585879 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.585981 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:17.589400 (+ 3419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.590482 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.594882 (+ 4400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.595563 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.595745 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.601197 (+ 5452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:17.601207 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:17.601211 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:17.601276 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:17.605311 (+ 4035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:17.606622 (+ 1311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:17.606631 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:17.606635 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:17.606879 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:17.607597 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:17.607603 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:17.607606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:17.608401 (+ 795us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:17.608731 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.613891 (+ 5160us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.614159 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":603,"threads_started":1}
I20260805 23:00:17.635597 24840 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:42959
I20260805 23:00:17.635618 25028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:42959 every 8 connection(s)
I20260805 23:00:17.637020 24840 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:17.637524 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.621872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:49455 (local address 127.22.45.126:38851)
0805 23:00:17.622132 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.622141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.623760 (+ 1619us) server_negotiation.cc:407] Connection header received
0805 23:00:17.624008 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.624013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.624104 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.624207 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:17.625321 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.626058 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.627605 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.628153 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.628289 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.630837 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:17.630843 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:17.630846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:17.630883 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:17.634178 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:17.635326 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:17.635331 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:17.635335 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:17.635501 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:17.635970 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:17.635974 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:17.635976 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:17.636300 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:17.636462 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.636891 (+ 429us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.637139 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 23:00:17.637642 25000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.621728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38851 (local address 127.22.45.67:49455)
0805 23:00:17.623556 (+ 1828us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:17.623586 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:17.623855 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:17.624250 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:17.624255 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:17.624814 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:17.625140 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.625151 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.626212 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.626219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.627435 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.627456 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.628357 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.628365 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.628536 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.629334 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:17.629353 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:17.630570 (+ 1217us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:17.634415 (+ 3845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:17.634422 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:17.634427 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:17.635161 (+ 734us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:17.635627 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:17.635633 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:17.635636 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:17.635843 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:17.636428 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:17.636434 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:17.636632 (+ 198us) client_negotiation.cc:769] Sending connection context
0805 23:00:17.636760 (+ 128us) client_negotiation.cc:240] Negotiation successful
0805 23:00:17.637162 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1656,"thread_start_us":1467,"threads_started":1}
I20260805 23:00:17.639592 25029 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38851
I20260805 23:00:17.639961 25029 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:17.640690 25029 heartbeater.cc:511] Master 127.22.45.126:38851 requested a full tablet report, sending...
I20260805 23:00:17.642385 24308 ts_manager.cc:194] Registered new tserver with Master: ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67:42959)
I20260805 23:00:17.643302 24308 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:39221
I20260805 23:00:17.643581 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 24840
I20260805 23:00:17.643860 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:17.644485 22709 external_mini_cluster.cc:1428] Setting key fc77dc1fdf3b9ac318213d18b343395a
I20260805 23:00:17.649219 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 23:00:17 dist-test-slave-1vmg krb5kdc[24239](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970817, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 23:00:17 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970817, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:17.704396 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.688138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46900 (local address 127.22.45.126:38851)
0805 23:00:17.688307 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.688312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.688700 (+ 388us) server_negotiation.cc:407] Connection header received
0805 23:00:17.688857 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.688862 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.688937 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.689048 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:17.690713 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.691562 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.693088 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.693737 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.693883 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.698854 (+ 4971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:17.698860 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:17.698864 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:17.698909 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:17.701689 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:17.702455 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:17.702461 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:17.702464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:17.702619 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:17.703027 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:17.703033 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:17.703036 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:17.703362 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:17.703606 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.703873 (+ 267us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.704079 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 23:00:17.709245 24308 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:17.716470 24308 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:17.746169 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.732249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46194 (local address 127.22.45.65:39445)
0805 23:00:17.732937 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.732946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.736272 (+ 3326us) server_negotiation.cc:407] Connection header received
0805 23:00:17.736791 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.736801 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.737093 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.737283 (+ 190us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:17.738967 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.740622 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.743810 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.744856 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.745003 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.745271 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.745665 (+ 394us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.745859 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":286,"threads_started":1}
I20260805 23:00:17.746565 25050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.732104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39445 (local address 127.0.0.1:46194)
0805 23:00:17.736057 (+ 3953us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:17.736125 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:17.736456 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:17.738123 (+ 1667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:17.738132 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:17.738183 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:17.738672 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.738685 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.740872 (+ 2187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.740877 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.743621 (+ 2744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.743635 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.745143 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.745150 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.745408 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.745454 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 23:00:17.745584 (+ 130us) client_negotiation.cc:240] Negotiation successful
0805 23:00:17.745831 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3630,"mutex_wait_us":23,"thread_start_us":6980,"threads_started":1}
I20260805 23:00:17.749751 25053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.737716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52748 (local address 127.22.45.66:44855)
0805 23:00:17.740619 (+ 2903us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.740628 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.742080 (+ 1452us) server_negotiation.cc:407] Connection header received
0805 23:00:17.742211 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.742220 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.742456 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.742641 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:17.743372 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.744865 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.747448 (+ 2583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.748612 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.748781 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.749006 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.749275 (+ 269us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.749475 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2734,"thread_start_us":2611,"threads_started":1}
I20260805 23:00:17.749810 25052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.737180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:44855 (local address 127.0.0.1:52748)
0805 23:00:17.741816 (+ 4636us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:17.741836 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:17.741950 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:17.742661 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:17.742665 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:17.742699 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:17.743189 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.743204 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.745046 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.745052 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.747251 (+ 2199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.747269 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.748884 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.748892 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.749076 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.749103 (+ 27us) client_negotiation.cc:769] Sending connection context
0805 23:00:17.749183 (+ 80us) client_negotiation.cc:240] Negotiation successful
0805 23:00:17.749347 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4505,"mutex_wait_us":63,"thread_start_us":3608,"threads_started":1}
I20260805 23:00:17.750525 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.735915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49384 (local address 127.22.45.67:42959)
0805 23:00:17.739940 (+ 4025us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.739950 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.739988 (+ 38us) server_negotiation.cc:407] Connection header received
0805 23:00:17.740096 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.740104 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.740426 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.740924 (+ 498us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:17.741615 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.743381 (+ 1766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.747502 (+ 4121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.748852 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.748997 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.749249 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.750014 (+ 765us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.750210 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3842,"thread_start_us":3607,"threads_started":1}
I20260805 23:00:17.750602 25048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.735136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:42959 (local address 127.0.0.1:49384)
0805 23:00:17.739421 (+ 4285us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:17.739444 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:17.739590 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:17.740704 (+ 1114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:17.740710 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:17.740743 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:17.741368 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.741382 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.743542 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.743547 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.747251 (+ 3704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.747269 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.749429 (+ 2160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.749436 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.749604 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.749637 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:00:17.749739 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 23:00:17.749894 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4124,"mutex_wait_us":27,"thread_start_us":1078,"threads_started":1}
I20260805 23:00:17.751421 24507 tablet_service.cc:1467] Processing CreateTablet for tablet dff6882189284feba4d3d3f8108831c4 (DEFAULT_TABLE table=test-table [id=19d8bb2b2e06488b815accc764e1c884]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:17.753114 24507 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff6882189284feba4d3d3f8108831c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:17.754037 24929 tablet_service.cc:1467] Processing CreateTablet for tablet dff6882189284feba4d3d3f8108831c4 (DEFAULT_TABLE table=test-table [id=19d8bb2b2e06488b815accc764e1c884]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:17.754055 24717 tablet_service.cc:1467] Processing CreateTablet for tablet dff6882189284feba4d3d3f8108831c4 (DEFAULT_TABLE table=test-table [id=19d8bb2b2e06488b815accc764e1c884]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:17.755637 24929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff6882189284feba4d3d3f8108831c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:17.755690 24717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff6882189284feba4d3d3f8108831c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:17.767176 25054 tablet_bootstrap.cc:492] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Bootstrap starting.
I20260805 23:00:17.770576 25054 tablet_bootstrap.cc:654] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:17.771603 25055 tablet_bootstrap.cc:492] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Bootstrap starting.
I20260805 23:00:17.772094 25054 log.cc:824] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:17.775344 25056 tablet_bootstrap.cc:492] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Bootstrap starting.
I20260805 23:00:17.775969 25055 tablet_bootstrap.cc:654] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:17.776067 25054 tablet_bootstrap.cc:492] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: No bootstrap required, opened a new log
I20260805 23:00:17.776396 25054 ts_tablet_manager.cc:1397] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260805 23:00:17.777609 25055 log.cc:824] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:17.779654 25056 tablet_bootstrap.cc:654] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:17.780834 25056 log.cc:824] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:17.781324 25055 tablet_bootstrap.cc:492] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: No bootstrap required, opened a new log
I20260805 23:00:17.781656 25055 ts_tablet_manager.cc:1397] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260805 23:00:17.783979 25056 tablet_bootstrap.cc:492] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: No bootstrap required, opened a new log
I20260805 23:00:17.784349 25056 ts_tablet_manager.cc:1397] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260805 23:00:17.787292 25054 raft_consensus.cc:348] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.787853 25054 raft_consensus.cc:374] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:17.787961 25054 raft_consensus.cc:729] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0943f8718a414c40a963de506a132aa9, State: Initialized, Role: FOLLOWER
I20260805 23:00:17.788738 25054 consensus_queue.cc:260] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.790979 25054 ts_tablet_manager.cc:1428] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260805 23:00:17.792415 25055 raft_consensus.cc:348] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.792829 25055 raft_consensus.cc:374] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:17.792933 25055 raft_consensus.cc:729] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e635471dfe704d90ac2f75ff700607da, State: Initialized, Role: FOLLOWER
I20260805 23:00:17.793555 25055 consensus_queue.cc:260] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.794690 24834 heartbeater.cc:503] Master 127.22.45.126:38851 was elected leader, sending a full tablet report...
I20260805 23:00:17.794517 25056 raft_consensus.cc:348] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.795061 25056 raft_consensus.cc:374] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:17.795164 25056 raft_consensus.cc:729] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad555e691a394cc193b69d6d36b6bc38, State: Initialized, Role: FOLLOWER
I20260805 23:00:17.795485 25055 ts_tablet_manager.cc:1428] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Time spent starting tablet: real 0.014s user 0.014s sys 0.002s
I20260805 23:00:17.795939 25056 consensus_queue.cc:260] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.797245 25029 heartbeater.cc:503] Master 127.22.45.126:38851 was elected leader, sending a full tablet report...
I20260805 23:00:17.798050 25056 ts_tablet_manager.cc:1428] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
I20260805 23:00:17.888269 25064 raft_consensus.cc:482] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:17.888583 25064 raft_consensus.cc:504] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
W20260805 23:00:17.890226 25030 tablet.cc:2369] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:00:17.890406 25064 leader_election.cc:288] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0943f8718a414c40a963de506a132aa9 (127.22.45.65:39445), ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67:42959)
I20260805 23:00:17.897795 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.891332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:38761 (local address 127.22.45.65:39445)
0805 23:00:17.891557 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.891563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.891916 (+ 353us) server_negotiation.cc:407] Connection header received
0805 23:00:17.892294 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.892301 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.892377 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.892457 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:17.893176 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.893882 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.896033 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.896793 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.896928 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.897007 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.897421 (+ 414us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.897545 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 23:00:17.897994 25067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.890878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:42959 (local address 127.22.45.66:41737)
0805 23:00:17.891865 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:17.891889 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:17.892076 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:17.892447 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:17.892451 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:17.892477 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:17.892927 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.892938 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.893974 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.893979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.895777 (+ 1798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.895791 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.897065 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.897070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.897254 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.897283 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 23:00:17.897370 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 23:00:17.897499 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":78,"spinlock_wait_cycles":43136,"thread_start_us":846,"threads_started":1}
I20260805 23:00:17.897831 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.891421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:41737 (local address 127.22.45.67:42959)
0805 23:00:17.891615 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.891621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.891982 (+ 361us) server_negotiation.cc:407] Connection header received
0805 23:00:17.892214 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.892220 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.892296 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.892384 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:17.893119 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.893836 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.895945 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.896812 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.897009 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.897095 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.897416 (+ 321us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.897553 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:00:17.898303 25069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.890747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39445 (local address 127.22.45.66:38761)
0805 23:00:17.891798 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:17.891818 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:17.892078 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:17.892578 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:17.892582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:17.892610 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:17.893022 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.893032 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.894063 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.894067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.895853 (+ 1786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:17.895872 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.897039 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.897050 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:17.897240 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.897270 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 23:00:17.897363 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 23:00:17.897516 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":903,"mutex_wait_us":45,"spinlock_wait_cycles":13184,"thread_start_us":816,"threads_started":1}
I20260805 23:00:17.899307 24549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff6882189284feba4d3d3f8108831c4" candidate_uuid: "e635471dfe704d90ac2f75ff700607da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0943f8718a414c40a963de506a132aa9" is_pre_election: true
I20260805 23:00:17.899338 24956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff6882189284feba4d3d3f8108831c4" candidate_uuid: "e635471dfe704d90ac2f75ff700607da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad555e691a394cc193b69d6d36b6bc38" is_pre_election: true
I20260805 23:00:17.899891 24549 raft_consensus.cc:2454] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e635471dfe704d90ac2f75ff700607da in term 0.
I20260805 23:00:17.899938 24956 raft_consensus.cc:2454] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e635471dfe704d90ac2f75ff700607da in term 0.
I20260805 23:00:17.900625 24657 leader_election.cc:302] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0943f8718a414c40a963de506a132aa9, ad555e691a394cc193b69d6d36b6bc38, e635471dfe704d90ac2f75ff700607da; no voters:
I20260805 23:00:17.901077 25064 raft_consensus.cc:2781] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:17.901233 25064 raft_consensus.cc:482] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:17.901347 25064 raft_consensus.cc:3037] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:17.903935 25064 raft_consensus.cc:504] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.904624 25064 leader_election.cc:288] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [CANDIDATE]: Term 1 election: Requested vote from peers 0943f8718a414c40a963de506a132aa9 (127.22.45.65:39445), ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67:42959)
I20260805 23:00:17.905305 24549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff6882189284feba4d3d3f8108831c4" candidate_uuid: "e635471dfe704d90ac2f75ff700607da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0943f8718a414c40a963de506a132aa9"
I20260805 23:00:17.905304 24956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff6882189284feba4d3d3f8108831c4" candidate_uuid: "e635471dfe704d90ac2f75ff700607da" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad555e691a394cc193b69d6d36b6bc38"
I20260805 23:00:17.905572 24549 raft_consensus.cc:3037] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:17.905561 24956 raft_consensus.cc:3037] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:17.909034 24549 raft_consensus.cc:2454] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e635471dfe704d90ac2f75ff700607da in term 1.
I20260805 23:00:17.909044 24956 raft_consensus.cc:2454] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e635471dfe704d90ac2f75ff700607da in term 1.
I20260805 23:00:17.909706 24657 leader_election.cc:302] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0943f8718a414c40a963de506a132aa9, e635471dfe704d90ac2f75ff700607da; no voters:
I20260805 23:00:17.910084 25064 raft_consensus.cc:2781] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:17.910583 25064 raft_consensus.cc:686] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 1 LEADER]: Becoming Leader. State: Replica: e635471dfe704d90ac2f75ff700607da, State: Running, Role: LEADER
I20260805 23:00:17.911156 25064 consensus_queue.cc:237] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } }
I20260805 23:00:17.916378 24306 catalog_manager.cc:5495] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da reported cstate change: term changed from 0 to 1, leader changed from <none> to e635471dfe704d90ac2f75ff700607da (127.22.45.66). New cstate: current_term: 1 leader_uuid: "e635471dfe704d90ac2f75ff700607da" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } health_report { overall_health: HEALTHY } } }
W20260805 23:00:17.923629 24619 tablet.cc:2369] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:00:17.949048 25053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:17.943056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52756 (local address 127.22.45.66:44855)
0805 23:00:17.943303 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:17.943309 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:17.943371 (+ 62us) server_negotiation.cc:407] Connection header received
0805 23:00:17.943747 (+ 376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:17.943752 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:17.943854 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:17.943987 (+ 133us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:17.944354 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.945111 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.946612 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:17.947083 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:17.947184 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:17.947783 (+ 599us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:17.948395 (+ 612us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:17.948505 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:17.948676 (+ 171us) server_negotiation.cc:299] Negotiation successful
0805 23:00:17.948758 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 23:00:17.959398 24549 raft_consensus.cc:1261] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Refusing update from remote peer e635471dfe704d90ac2f75ff700607da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:17.959400 24956 raft_consensus.cc:1261] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Refusing update from remote peer e635471dfe704d90ac2f75ff700607da: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:17.960862 25064 consensus_queue.cc:1035] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:17.961292 25071 consensus_queue.cc:1035] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [LEADER]: Connected to new peer: Peer: permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:18.012989 24308 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:18.013427 24308 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:18.018142 24308 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d: Sending DeleteTablet for 3 replicas of tablet dff6882189284feba4d3d3f8108831c4
I20260805 23:00:18.019801 24929 tablet_service.cc:1514] Processing DeleteTablet for tablet dff6882189284feba4d3d3f8108831c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:18 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:49384
I20260805 23:00:18.019807 24507 tablet_service.cc:1514] Processing DeleteTablet for tablet dff6882189284feba4d3d3f8108831c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:18 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:46194
I20260805 23:00:18.023499 25090 tablet_replica.cc:330] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: stopping tablet replica
I20260805 23:00:18.023947 24717 tablet_service.cc:1514] Processing DeleteTablet for tablet dff6882189284feba4d3d3f8108831c4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:18 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:52748
I20260805 23:00:18.024309 25090 raft_consensus.cc:2229] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:18.024960 25090 raft_consensus.cc:2258] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:18.027676 25090 ts_tablet_manager.cc:1905] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:18.027724 24308 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:18.028558 24308 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:18.036125 25090 ts_tablet_manager.cc:1918] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:18.036485 25090 log.cc:1196] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/dff6882189284feba4d3d3f8108831c4
I20260805 23:00:18.037173 25090 ts_tablet_manager.cc:1939] T dff6882189284feba4d3d3f8108831c4 P ad555e691a394cc193b69d6d36b6bc38: Deleting consensus metadata
I20260805 23:00:18.038136 24716 tablet_service.cc:1467] Processing CreateTablet for tablet 238d24de4e444663a8003bde1cf4a6d0 (DEFAULT_TABLE table=test-table [id=c2e19e4d0aa141ab9719863ba028edca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:18.038178 24505 tablet_service.cc:1467] Processing CreateTablet for tablet 238d24de4e444663a8003bde1cf4a6d0 (DEFAULT_TABLE table=test-table [id=c2e19e4d0aa141ab9719863ba028edca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:18.038764 24716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238d24de4e444663a8003bde1cf4a6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:18.038796 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238d24de4e444663a8003bde1cf4a6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:18.042994 25088 tablet_replica.cc:330] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: stopping tablet replica
I20260805 23:00:18.043561 25088 raft_consensus.cc:2229] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:18.043751 24281 catalog_manager.cc:4841] TS ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67:42959): tablet dff6882189284feba4d3d3f8108831c4 (table test-table [id=19d8bb2b2e06488b815accc764e1c884]) successfully deleted
I20260805 23:00:18.044183 25088 raft_consensus.cc:2258] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:18.045992 25054 tablet_bootstrap.cc:492] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: Bootstrap starting.
I20260805 23:00:18.046391 24929 tablet_service.cc:1467] Processing CreateTablet for tablet 238d24de4e444663a8003bde1cf4a6d0 (DEFAULT_TABLE table=test-table [id=c2e19e4d0aa141ab9719863ba028edca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:18.046967 24929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 238d24de4e444663a8003bde1cf4a6d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:18.047712 25054 tablet_bootstrap.cc:654] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:18.048955 25088 ts_tablet_manager.cc:1905] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:18.054790 25055 tablet_bootstrap.cc:492] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Bootstrap starting.
I20260805 23:00:18.057168 25055 tablet_bootstrap.cc:654] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:18.058495 25056 tablet_bootstrap.cc:492] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: Bootstrap starting.
I20260805 23:00:18.060487 25056 tablet_bootstrap.cc:654] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:18.062611 25054 tablet_bootstrap.cc:492] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: No bootstrap required, opened a new log
I20260805 23:00:18.062821 25054 ts_tablet_manager.cc:1397] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20260805 23:00:18.063822 25054 raft_consensus.cc:348] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.064096 25054 raft_consensus.cc:374] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:18.064213 25054 raft_consensus.cc:729] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0943f8718a414c40a963de506a132aa9, State: Initialized, Role: FOLLOWER
I20260805 23:00:18.065872 25054 consensus_queue.cc:260] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.069680 25054 ts_tablet_manager.cc:1428] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260805 23:00:18.073758 25088 ts_tablet_manager.cc:1918] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:18.074004 25088 log.cc:1196] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/dff6882189284feba4d3d3f8108831c4
I20260805 23:00:18.074721 25088 ts_tablet_manager.cc:1939] T dff6882189284feba4d3d3f8108831c4 P 0943f8718a414c40a963de506a132aa9: Deleting consensus metadata
I20260805 23:00:18.075192 25056 tablet_bootstrap.cc:492] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: No bootstrap required, opened a new log
I20260805 23:00:18.075448 25056 ts_tablet_manager.cc:1397] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.001s
I20260805 23:00:18.076469 25056 raft_consensus.cc:348] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.077085 24283 catalog_manager.cc:4841] TS 0943f8718a414c40a963de506a132aa9 (127.22.45.65:39445): tablet dff6882189284feba4d3d3f8108831c4 (table test-table [id=19d8bb2b2e06488b815accc764e1c884]) successfully deleted
I20260805 23:00:18.077363 25056 raft_consensus.cc:374] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:18.077502 25056 raft_consensus.cc:729] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad555e691a394cc193b69d6d36b6bc38, State: Initialized, Role: FOLLOWER
I20260805 23:00:18.077811 25056 consensus_queue.cc:260] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.078455 25091 tablet_replica.cc:330] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: stopping tablet replica
I20260805 23:00:18.078985 25055 tablet_bootstrap.cc:492] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: No bootstrap required, opened a new log
I20260805 23:00:18.079523 25056 ts_tablet_manager.cc:1428] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s
I20260805 23:00:18.079030 25091 raft_consensus.cc:2229] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:18.080628 25091 raft_consensus.cc:2258] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:18.081103 25055 ts_tablet_manager.cc:1397] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.007s
I20260805 23:00:18.082136 25055 raft_consensus.cc:348] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.082401 25055 raft_consensus.cc:374] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:18.082517 25055 raft_consensus.cc:729] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e635471dfe704d90ac2f75ff700607da, State: Initialized, Role: FOLLOWER
I20260805 23:00:18.082808 25055 consensus_queue.cc:260] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.083429 25055 ts_tablet_manager.cc:1428] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260805 23:00:18.084440 25091 ts_tablet_manager.cc:1905] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:18.089660 25066 raft_consensus.cc:482] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:18.089926 25066 raft_consensus.cc:504] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.091463 25091 ts_tablet_manager.cc:1918] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:18.091650 25091 log.cc:1196] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/dff6882189284feba4d3d3f8108831c4
I20260805 23:00:18.092032 25066 leader_election.cc:288] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0943f8718a414c40a963de506a132aa9 (127.22.45.65:39445), e635471dfe704d90ac2f75ff700607da (127.22.45.66:44855)
I20260805 23:00:18.092311 25091 ts_tablet_manager.cc:1939] T dff6882189284feba4d3d3f8108831c4 P e635471dfe704d90ac2f75ff700607da: Deleting consensus metadata
I20260805 23:00:18.095033 24281 catalog_manager.cc:4841] TS e635471dfe704d90ac2f75ff700607da (127.22.45.66:44855): tablet dff6882189284feba4d3d3f8108831c4 (table test-table [id=19d8bb2b2e06488b815accc764e1c884]) successfully deleted
I20260805 23:00:18.101341 25053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.094134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:53621 (local address 127.22.45.66:44855)
0805 23:00:18.094313 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.094319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.094337 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:00:18.094401 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.094406 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.094495 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.094601 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:18.095296 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.096469 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.098836 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.100168 (+ 1332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.100265 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.100319 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.100883 (+ 564us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.101030 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:00:18.102075 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.092693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:34251 (local address 127.22.45.65:39445)
0805 23:00:18.092889 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.092896 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.093560 (+ 664us) server_negotiation.cc:407] Connection header received
0805 23:00:18.093654 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.093661 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.093744 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.093842 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:18.094330 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.095486 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.098327 (+ 2841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.099714 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.099919 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.100003 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.101629 (+ 1626us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.101794 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260805 23:00:18.101413 24875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.092283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39445 (local address 127.22.45.67:34251)
0805 23:00:18.093141 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.093168 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.093327 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.093888 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.093894 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.093923 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:18.094132 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.094143 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.095728 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.095735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.097781 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.097796 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.100461 (+ 2665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.100468 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.100782 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.100822 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.100916 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.101066 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"mutex_wait_us":48}
I20260805 23:00:18.101485 25096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.092705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:44855 (local address 127.22.45.67:53621)
0805 23:00:18.093366 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.093385 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.093518 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.094644 (+ 1126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.094649 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.094677 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:18.095100 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.095114 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.096684 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.096691 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.098643 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.098658 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.100498 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.100502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.100712 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.100738 (+ 26us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.100823 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.100971 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":25,"thread_start_us":2573,"threads_started":1}
I20260805 23:00:18.103113 24549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238d24de4e444663a8003bde1cf4a6d0" candidate_uuid: "ad555e691a394cc193b69d6d36b6bc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0943f8718a414c40a963de506a132aa9" is_pre_election: true
I20260805 23:00:18.103416 24549 raft_consensus.cc:2454] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad555e691a394cc193b69d6d36b6bc38 in term 0.
I20260805 23:00:18.103576 24762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238d24de4e444663a8003bde1cf4a6d0" candidate_uuid: "ad555e691a394cc193b69d6d36b6bc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e635471dfe704d90ac2f75ff700607da" is_pre_election: true
I20260805 23:00:18.103991 24865 leader_election.cc:302] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0943f8718a414c40a963de506a132aa9, ad555e691a394cc193b69d6d36b6bc38; no voters:
I20260805 23:00:18.104094 24762 raft_consensus.cc:2454] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad555e691a394cc193b69d6d36b6bc38 in term 0.
I20260805 23:00:18.104480 25066 raft_consensus.cc:2781] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:18.104636 25066 raft_consensus.cc:482] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:18.104754 25066 raft_consensus.cc:3037] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:18.107261 25066 raft_consensus.cc:504] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.107950 25066 leader_election.cc:288] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [CANDIDATE]: Term 1 election: Requested vote from peers 0943f8718a414c40a963de506a132aa9 (127.22.45.65:39445), e635471dfe704d90ac2f75ff700607da (127.22.45.66:44855)
I20260805 23:00:18.108610 24549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238d24de4e444663a8003bde1cf4a6d0" candidate_uuid: "ad555e691a394cc193b69d6d36b6bc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0943f8718a414c40a963de506a132aa9"
I20260805 23:00:18.108865 24549 raft_consensus.cc:3037] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:18.111163 24762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "238d24de4e444663a8003bde1cf4a6d0" candidate_uuid: "ad555e691a394cc193b69d6d36b6bc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e635471dfe704d90ac2f75ff700607da"
I20260805 23:00:18.111407 24762 raft_consensus.cc:3037] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:18.112061 24549 raft_consensus.cc:2454] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad555e691a394cc193b69d6d36b6bc38 in term 1.
I20260805 23:00:18.112597 24865 leader_election.cc:302] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0943f8718a414c40a963de506a132aa9, ad555e691a394cc193b69d6d36b6bc38; no voters:
I20260805 23:00:18.112946 25066 raft_consensus.cc:2781] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:18.113481 25066 raft_consensus.cc:686] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 1 LEADER]: Becoming Leader. State: Replica: ad555e691a394cc193b69d6d36b6bc38, State: Running, Role: LEADER
I20260805 23:00:18.113961 25066 consensus_queue.cc:237] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.114672 24762 raft_consensus.cc:2454] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad555e691a394cc193b69d6d36b6bc38 in term 1.
I20260805 23:00:18.118130 24308 catalog_manager.cc:5495] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67). New cstate: current_term: 1 leader_uuid: "ad555e691a394cc193b69d6d36b6bc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } health_report { overall_health: HEALTHY } } }
Aug 05 23:00:18 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970815, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:18.167006 25111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.149808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38851 (local address 127.0.0.1:46912)
0805 23:00:18.150545 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.150637 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.150815 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.151264 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.151268 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.152117 (+ 849us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:18.152403 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.152413 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.153989 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.153994 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.155116 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.155130 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.156250 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.156256 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.156383 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.157222 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:18.157242 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:18.159946 (+ 2704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:18.164216 (+ 4270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:18.164237 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:18.164244 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:18.164776 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:18.165198 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:18.165202 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:18.165204 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:18.165343 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:18.166000 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:18.166008 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:18.166182 (+ 174us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.166343 (+ 161us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.166592 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":404,"threads_started":1}
I20260805 23:00:18.167236 24873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.149887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46912 (local address 127.22.45.126:38851)
0805 23:00:18.150101 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.150109 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.150809 (+ 700us) server_negotiation.cc:407] Connection header received
0805 23:00:18.150966 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.150972 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.151056 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.151177 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:18.152566 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.153827 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.155274 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.156002 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.156180 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.160195 (+ 4015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:18.160202 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:18.160207 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:18.160253 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:18.163999 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.164918 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.164923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.164927 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.165094 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.165448 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.165453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.165457 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.165857 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:18.166017 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.166464 (+ 447us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.166780 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":34,"server-negotiator.queue_time_us":67}
I20260805 23:00:18.174265 24308 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:46912:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 23:00:18.175761 24308 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:18.185145 24505 tablet_service.cc:1467] Processing CreateTablet for tablet f533eeac05054ffcacbf3c3732540c8e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=570efd59c37d4f75835577c29c6faeff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:00:18.185134 24717 tablet_service.cc:1467] Processing CreateTablet for tablet f533eeac05054ffcacbf3c3732540c8e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=570efd59c37d4f75835577c29c6faeff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:00:18.185807 24717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f533eeac05054ffcacbf3c3732540c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:18.185799 24505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f533eeac05054ffcacbf3c3732540c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:18.187618 24929 tablet_service.cc:1467] Processing CreateTablet for tablet f533eeac05054ffcacbf3c3732540c8e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=570efd59c37d4f75835577c29c6faeff]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:00:18.188254 24929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f533eeac05054ffcacbf3c3732540c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:18.193595 25055 tablet_bootstrap.cc:492] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: Bootstrap starting.
I20260805 23:00:18.193696 25054 tablet_bootstrap.cc:492] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: Bootstrap starting.
I20260805 23:00:18.195598 25054 tablet_bootstrap.cc:654] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:18.195621 25055 tablet_bootstrap.cc:654] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:18.197597 25056 tablet_bootstrap.cc:492] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: Bootstrap starting.
I20260805 23:00:18.199705 25056 tablet_bootstrap.cc:654] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:18.205700 25056 tablet_bootstrap.cc:492] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: No bootstrap required, opened a new log
I20260805 23:00:18.205909 25056 ts_tablet_manager.cc:1397] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260805 23:00:18.205909 25055 tablet_bootstrap.cc:492] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: No bootstrap required, opened a new log
I20260805 23:00:18.206193 25055 ts_tablet_manager.cc:1397] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260805 23:00:18.206729 25056 raft_consensus.cc:348] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.207029 25056 raft_consensus.cc:374] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:18.206887 25055 raft_consensus.cc:348] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.207130 25056 raft_consensus.cc:729] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad555e691a394cc193b69d6d36b6bc38, State: Initialized, Role: FOLLOWER
I20260805 23:00:18.207176 25055 raft_consensus.cc:374] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:18.207273 25055 raft_consensus.cc:729] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e635471dfe704d90ac2f75ff700607da, State: Initialized, Role: FOLLOWER
I20260805 23:00:18.207365 25056 consensus_queue.cc:260] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.207536 25055 consensus_queue.cc:260] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.207891 25056 ts_tablet_manager.cc:1428] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 23:00:18.208128 25064 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.208452 25064 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:18.208948 25055 ts_tablet_manager.cc:1428] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260805 23:00:18.210891 25054 tablet_bootstrap.cc:492] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: No bootstrap required, opened a new log
I20260805 23:00:18.211114 25054 ts_tablet_manager.cc:1397] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.004s
I20260805 23:00:18.211763 25054 raft_consensus.cc:348] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.212001 25054 raft_consensus.cc:374] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:18.212082 25054 raft_consensus.cc:729] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0943f8718a414c40a963de506a132aa9, State: Initialized, Role: FOLLOWER
I20260805 23:00:18.212046 25066 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.212409 25066 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:18.212327 25054 consensus_queue.cc:260] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.212978 25054 ts_tablet_manager.cc:1428] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260805 23:00:18.212795 25063 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.213174 25063 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: This TxnStatusTablet replica's current role is: FOLLOWER
W20260805 23:00:18.229154 24835 tablet.cc:2369] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:00:18.241402 25063 raft_consensus.cc:482] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:18.241670 25063 raft_consensus.cc:504] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.243292 25063 leader_election.cc:288] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e635471dfe704d90ac2f75ff700607da (127.22.45.66:44855), ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67:42959)
I20260805 23:00:18.251889 25053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.243703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:52661 (local address 127.22.45.66:44855)
0805 23:00:18.243910 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.243917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.244397 (+ 480us) server_negotiation.cc:407] Connection header received
0805 23:00:18.244648 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.244653 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.244750 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.244823 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:18.245790 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.246792 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.249007 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.250377 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.250552 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.250640 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.251424 (+ 784us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.251582 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 23:00:18.251933 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.243683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:44855 (local address 127.22.45.65:52661)
0805 23:00:18.244280 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.244297 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.244456 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.245064 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.245069 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.245106 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:18.245565 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.245580 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.246948 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.246954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.248779 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.248797 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.250594 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.250601 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.250759 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.250784 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.251375 (+ 591us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.251533 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":1,"thread_start_us":328,"threads_started":1}
I20260805 23:00:18.252790 24762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533eeac05054ffcacbf3c3732540c8e" candidate_uuid: "0943f8718a414c40a963de506a132aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e635471dfe704d90ac2f75ff700607da" is_pre_election: true
I20260805 23:00:18.253099 24762 raft_consensus.cc:2454] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0943f8718a414c40a963de506a132aa9 in term 0.
I20260805 23:00:18.253340 25122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.244486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:42959 (local address 127.22.45.65:46791)
0805 23:00:18.245424 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.245443 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.245589 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.245990 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.245995 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.246024 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:18.246385 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.246397 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.248038 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.248044 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.250159 (+ 2115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.250176 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.252288 (+ 2112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.252296 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.252506 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.252550 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.252731 (+ 181us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.252892 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":43,"thread_start_us":526,"threads_started":1}
I20260805 23:00:18.253644 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.244680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:46791 (local address 127.22.45.67:42959)
0805 23:00:18.244862 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.244868 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.245565 (+ 697us) server_negotiation.cc:407] Connection header received
0805 23:00:18.245757 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.245763 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.245853 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.245972 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:18.246582 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.247873 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.250414 (+ 2541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.251817 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.252001 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.252091 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.252755 (+ 664us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.252901 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 23:00:18.253651 24436 leader_election.cc:302] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0943f8718a414c40a963de506a132aa9, e635471dfe704d90ac2f75ff700607da; no voters:
I20260805 23:00:18.254163 25063 raft_consensus.cc:2781] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:18.254310 25063 raft_consensus.cc:482] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:18.254426 25063 raft_consensus.cc:3037] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:18.254592 24956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533eeac05054ffcacbf3c3732540c8e" candidate_uuid: "0943f8718a414c40a963de506a132aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad555e691a394cc193b69d6d36b6bc38" is_pre_election: true
I20260805 23:00:18.254858 24956 raft_consensus.cc:2454] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0943f8718a414c40a963de506a132aa9 in term 0.
I20260805 23:00:18.257982 25063 raft_consensus.cc:504] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.258886 25063 leader_election.cc:288] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [CANDIDATE]: Term 1 election: Requested vote from peers e635471dfe704d90ac2f75ff700607da (127.22.45.66:44855), ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67:42959)
I20260805 23:00:18.259565 24762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533eeac05054ffcacbf3c3732540c8e" candidate_uuid: "0943f8718a414c40a963de506a132aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e635471dfe704d90ac2f75ff700607da"
I20260805 23:00:18.259866 24762 raft_consensus.cc:3037] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:18.260075 24956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f533eeac05054ffcacbf3c3732540c8e" candidate_uuid: "0943f8718a414c40a963de506a132aa9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad555e691a394cc193b69d6d36b6bc38"
I20260805 23:00:18.260314 24956 raft_consensus.cc:3037] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:18.263299 24956 raft_consensus.cc:2454] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0943f8718a414c40a963de506a132aa9 in term 1.
I20260805 23:00:18.263290 24762 raft_consensus.cc:2454] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0943f8718a414c40a963de506a132aa9 in term 1.
I20260805 23:00:18.263804 24436 leader_election.cc:302] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0943f8718a414c40a963de506a132aa9, ad555e691a394cc193b69d6d36b6bc38; no voters:
I20260805 23:00:18.264192 25063 raft_consensus.cc:2781] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:18.264775 25063 raft_consensus.cc:686] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [term 1 LEADER]: Becoming Leader. State: Replica: 0943f8718a414c40a963de506a132aa9, State: Running, Role: LEADER
I20260805 23:00:18.265252 25063 consensus_queue.cc:237] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } }
I20260805 23:00:18.267822 25123 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: TxnStatusTablet state changed. Reason: New leader 0943f8718a414c40a963de506a132aa9. Latest consensus state: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.268388 25123 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:00:18.269459 25127 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 23:00:18.269748 25127 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 23:00:18.269954 24308 catalog_manager.cc:5495] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0943f8718a414c40a963de506a132aa9 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } health_report { overall_health: UNKNOWN } } }
I20260805 23:00:18.298641 25111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.290123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39445 (local address 127.0.0.1:46208)
0805 23:00:18.290382 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.290408 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.290618 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.291581 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.291586 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.291602 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:00:18.291842 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.291857 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.293387 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.293393 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.295114 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.295135 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.296347 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.296355 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.296544 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.296642 (+ 98us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:00:18.297939 (+ 1297us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:00:18.297970 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.298087 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.298283 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260805 23:00:18.298703 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.290193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46208 (local address 127.22.45.65:39445)
0805 23:00:18.291016 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.291024 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.291052 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:00:18.291183 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.291189 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.291337 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.291535 (+ 198us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:18.292031 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.293229 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.295313 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.296131 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.296288 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.296891 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:18.297765 (+ 874us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:18.297966 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.298125 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.298252 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636}
I20260805 23:00:18.305555 24956 raft_consensus.cc:1261] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Refusing update from remote peer 0943f8718a414c40a963de506a132aa9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:18.306020 24762 raft_consensus.cc:1261] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Refusing update from remote peer 0943f8718a414c40a963de506a132aa9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:18.306432 25063 consensus_queue.cc:1035] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:18.306972 25123 consensus_queue.cc:1035] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:18.321307 25123 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.321312 25066 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: TxnStatusTablet state changed. Reason: New leader 0943f8718a414c40a963de506a132aa9. Latest consensus state: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.321631 25066 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:18.321647 25123 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:00:18.321875 25080 mvcc.cc:205] Tried to move back new op lower bound from 7315336471770370048 to 7315336471619452928. Current Snapshot: MvccSnapshot[applied={T|T < 7315336471770370048}]
I20260805 23:00:18.322353 25081 mvcc.cc:205] Tried to move back new op lower bound from 7315336471770370048 to 7315336471619452928. Current Snapshot: MvccSnapshot[applied={T|T < 7315336471770370048}]
I20260805 23:00:18.323699 25066 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.323999 25066 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P ad555e691a394cc193b69d6d36b6bc38: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:18.325820 25064 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: TxnStatusTablet state changed. Reason: New leader 0943f8718a414c40a963de506a132aa9. Latest consensus state: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.326122 25064 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:18.330641 25063 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.331007 25063 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P 0943f8718a414c40a963de506a132aa9: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:00:18.337774 25064 tablet_replica.cc:439] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0943f8718a414c40a963de506a132aa9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 } } peers { permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 } } peers { permanent_uuid: "ad555e691a394cc193b69d6d36b6bc38" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 42959 } } }
I20260805 23:00:18.338133 25064 tablet_replica.cc:442] T f533eeac05054ffcacbf3c3732540c8e P e635471dfe704d90ac2f75ff700607da: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:18.354800 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.345884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49398 (local address 127.22.45.67:42959)
0805 23:00:18.346111 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.346117 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.346139 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:00:18.346264 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.346270 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.346406 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.346599 (+ 193us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:18.347375 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.348501 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.350705 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.351492 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.351652 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.352477 (+ 825us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:18.353339 (+ 862us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:18.353504 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.354316 (+ 812us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.354429 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260805 23:00:18.384918 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.376056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:40561 (local address 127.22.45.65:39445)
0805 23:00:18.376268 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.376274 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.377041 (+ 767us) server_negotiation.cc:407] Connection header received
0805 23:00:18.377388 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.377399 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.377493 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.377559 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:18.378415 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.379635 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.382010 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.382861 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.383030 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.383867 (+ 837us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:18.384038 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:18.384107 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.384424 (+ 317us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.384532 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 23:00:18.386183 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.375840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39445 (local address 127.22.45.67:40561)
0805 23:00:18.376898 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.376920 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.377184 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.377777 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.377783 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.377798 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:00:18.378188 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.378201 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.379908 (+ 1707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.379915 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.381755 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.381782 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.383287 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.383295 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.383508 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.383597 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:00:18.384251 (+ 654us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:00:18.384264 (+ 13us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.385543 (+ 1279us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.385750 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":574,"threads_started":1}
I20260805 23:00:18.404053 24762 raft_consensus.cc:1261] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Refusing update from remote peer ad555e691a394cc193b69d6d36b6bc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:18.405783 24549 raft_consensus.cc:1261] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Refusing update from remote peer ad555e691a394cc193b69d6d36b6bc38: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:18.405993 25066 consensus_queue.cc:1035] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e635471dfe704d90ac2f75ff700607da" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:18.407133 25066 consensus_queue.cc:1035] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0943f8718a414c40a963de506a132aa9" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:18.477273 25141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.468482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:42959 (local address 127.22.45.65:58499)
0805 23:00:18.469958 (+ 1476us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:18.469977 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:18.470223 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:18.471211 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:18.471216 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:18.471230 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:00:18.471702 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.471717 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.473251 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.473256 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.474734 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:18.474754 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.475801 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.475811 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:18.475993 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.476083 (+ 90us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:00:18.476521 (+ 438us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:00:18.476535 (+ 14us) client_negotiation.cc:769] Sending connection context
0805 23:00:18.476613 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 23:00:18.476778 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1267,"thread_start_us":439,"threads_started":1}
I20260805 23:00:18.478405 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.468534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:58499 (local address 127.22.45.67:42959)
0805 23:00:18.468747 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.468753 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.470097 (+ 1344us) server_negotiation.cc:407] Connection header received
0805 23:00:18.470389 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.470396 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.470490 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.470686 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:18.471955 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.473042 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.474962 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.475490 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.475644 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.476286 (+ 642us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:18.476413 (+ 127us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:18.476491 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.476649 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.476738 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 23:00:18.541114 24308 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:18.541437 24308 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:18.545794 24308 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c457582d6f3c46b1a52a49d4d1c4d55d: Sending DeleteTablet for 3 replicas of tablet 238d24de4e444663a8003bde1cf4a6d0
I20260805 23:00:18.547575 24929 tablet_service.cc:1514] Processing DeleteTablet for tablet 238d24de4e444663a8003bde1cf4a6d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:18 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:49384
I20260805 23:00:18.550305 24505 tablet_service.cc:1514] Processing DeleteTablet for tablet 238d24de4e444663a8003bde1cf4a6d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:18 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:46194
I20260805 23:00:18.550751 25088 tablet_replica.cc:330] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: stopping tablet replica
I20260805 23:00:18.551023 25088 raft_consensus.cc:2229] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:18.551285 25088 raft_consensus.cc:2258] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:18.553179 25088 ts_tablet_manager.cc:1905] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:18.555610 24717 tablet_service.cc:1514] Processing DeleteTablet for tablet 238d24de4e444663a8003bde1cf4a6d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:18 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:52748
I20260805 23:00:18.556007 25091 tablet_replica.cc:330] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: stopping tablet replica
I20260805 23:00:18.556248 25091 raft_consensus.cc:2229] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:18.556478 25091 raft_consensus.cc:2258] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:18.558125 25091 ts_tablet_manager.cc:1905] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:18.582274 25088 ts_tablet_manager.cc:1918] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:18.588272 25091 ts_tablet_manager.cc:1918] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:18.588514 25091 log.cc:1196] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/238d24de4e444663a8003bde1cf4a6d0
I20260805 23:00:18.589061 25091 ts_tablet_manager.cc:1939] T 238d24de4e444663a8003bde1cf4a6d0 P e635471dfe704d90ac2f75ff700607da: Deleting consensus metadata
I20260805 23:00:18.591936 25088 log.cc:1196] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/238d24de4e444663a8003bde1cf4a6d0
I20260805 23:00:18.595122 25145 tablet_replica.cc:330] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: stopping tablet replica
I20260805 23:00:18.596974 25088 ts_tablet_manager.cc:1939] T 238d24de4e444663a8003bde1cf4a6d0 P 0943f8718a414c40a963de506a132aa9: Deleting consensus metadata
I20260805 23:00:18.598774 25145 raft_consensus.cc:2229] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:18.600795 24283 catalog_manager.cc:4841] TS 0943f8718a414c40a963de506a132aa9 (127.22.45.65:39445): tablet 238d24de4e444663a8003bde1cf4a6d0 (table test-table [id=c2e19e4d0aa141ab9719863ba028edca]) successfully deleted
I20260805 23:00:18.603139 24281 catalog_manager.cc:4841] TS e635471dfe704d90ac2f75ff700607da (127.22.45.66:44855): tablet 238d24de4e444663a8003bde1cf4a6d0 (table test-table [id=c2e19e4d0aa141ab9719863ba028edca]) successfully deleted
I20260805 23:00:18.599582 25145 raft_consensus.cc:2258] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:18.604977 25145 ts_tablet_manager.cc:1905] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:18.615028 25145 ts_tablet_manager.cc:1918] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:18.615322 25145 log.cc:1196] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/238d24de4e444663a8003bde1cf4a6d0
I20260805 23:00:18.615900 25145 ts_tablet_manager.cc:1939] T 238d24de4e444663a8003bde1cf4a6d0 P ad555e691a394cc193b69d6d36b6bc38: Deleting consensus metadata
I20260805 23:00:18.617334 24281 catalog_manager.cc:4841] TS ad555e691a394cc193b69d6d36b6bc38 (127.22.45.67:42959): tablet 238d24de4e444663a8003bde1cf4a6d0 (table test-table [id=c2e19e4d0aa141ab9719863ba028edca]) successfully deleted
Aug 05 23:00:18 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970817, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:18.634071 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.597593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46214 (local address 127.22.45.65:39445)
0805 23:00:18.597858 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.597865 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.603883 (+ 6018us) server_negotiation.cc:407] Connection header received
0805 23:00:18.604308 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.604315 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.604422 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.604503 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:18.611163 (+ 6660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.612676 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.614838 (+ 2162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.615626 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.615767 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.622720 (+ 6953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:18.622743 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:18.622764 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:18.622837 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:18.627754 (+ 4917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.629171 (+ 1417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.629185 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.629208 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.629443 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.630547 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.630556 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.630561 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.631519 (+ 958us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:18.632044 (+ 525us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.633059 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.633497 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
W20260805 23:00:18.651906 24608 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46214
I20260805 23:00:18.712190 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.669222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46918 (local address 127.22.45.126:38851)
0805 23:00:18.687379 (+ 18157us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.687384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.688345 (+ 961us) server_negotiation.cc:407] Connection header received
0805 23:00:18.688587 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.688593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.688689 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.688813 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:18.691225 (+ 2412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.692494 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.694675 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.695384 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.695579 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.703920 (+ 8341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:18.703931 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:18.703936 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:18.703997 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:18.708215 (+ 4218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.709301 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.709308 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.709312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.709508 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.710022 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.710028 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.710031 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.710473 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:18.710747 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.711468 (+ 721us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.711779 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18026,"thread_start_us":17874,"threads_started":1}
W20260805 23:00:18.713881 24308 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46918
I20260805 23:00:18.716552 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 24413
I20260805 23:00:18.748451 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.720671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46226 (local address 127.22.45.65:39445)
0805 23:00:18.720895 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.720901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.729436 (+ 8535us) server_negotiation.cc:407] Connection header received
0805 23:00:18.730012 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.730019 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.730129 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.730213 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:18.732668 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.733903 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.736006 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.736754 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.736878 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.740505 (+ 3627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:18.740513 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:18.740519 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:18.740573 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:18.744760 (+ 4187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.745760 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.745767 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.745771 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.745935 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.746414 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.746420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.746423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.746829 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:18.747141 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.747766 (+ 625us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.748048 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260805 23:00:18.750661 24608 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46226
W20260805 23:00:18.751459 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 24413: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:18.751678 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 24413
I20260805 23:00:18.778442 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 24623
Aug 05 23:00:18 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970817, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:18.800376 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.779245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52764 (local address 127.22.45.66:44855)
0805 23:00:18.779752 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.779757 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.779775 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:00:18.779833 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.779837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.779913 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.780006 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:18.781812 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.782743 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.785005 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.785526 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.785649 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.792044 (+ 6395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:18.792072 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:18.792095 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:18.792159 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:18.796317 (+ 4158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.797268 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.797277 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.797280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.797452 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.797887 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.797891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.797893 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.798613 (+ 720us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:18.799208 (+ 595us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.799589 (+ 381us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.799934 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":263,"threads_started":1}
W20260805 23:00:18.801272 24826 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52764
W20260805 23:00:18.802747 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 24623: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:18.803022 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 24623
I20260805 23:00:18.844725 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 24840
Aug 05 23:00:18 dist-test-slave-1vmg krb5kdc[24239](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970817, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:18.866150 25051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:18.845695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49410 (local address 127.22.45.67:42959)
0805 23:00:18.845888 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:18.845893 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:18.845919 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:00:18.846120 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:18.846124 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:18.846192 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:18.846308 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:18.848109 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.848942 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.851067 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:18.851689 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:18.851825 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:18.857937 (+ 6112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:18.857954 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:18.857972 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:18.858028 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:18.861597 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.862847 (+ 1250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.862859 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.862862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.863295 (+ 433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:18.863893 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:18.863897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:18.863900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:18.864513 (+ 613us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:18.864908 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:18.865333 (+ 425us) server_negotiation.cc:299] Negotiation successful
0805 23:00:18.865710 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260805 23:00:18.867168 25023 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49410
W20260805 23:00:18.868301 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 24840: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:18.868518 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 24840
I20260805 23:00:18.891037 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 24254
I20260805 23:00:18.892302 24366 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:19.010519 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 24254
2026-08-05T23:00:19Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5187 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:19 dist-test-slave-1vmg krb5kdc[25167](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:19 dist-test-slave-1vmg krb5kdc[25167](info): set up 2 sockets
Aug 05 23:00:19 dist-test-slave-1vmg krb5kdc[25167](info): commencing operation
krb5kdc: starting...
W20260805 23:00:20.206866 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:20 dist-test-slave-1vmg krb5kdc[25167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:20.438730 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38041
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:38041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:20.799352 25186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:20.799757 25186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:20.799922 25186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:20.807986 25186 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:20.808149 25186 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 23:00:20.808223 25186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:20.808329 25186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:20.808408 25186 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:20.808516 25186 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:20.819350 25186 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:38041
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:20.820976 25186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:20.822553 25186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:20.837044 25198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:20.837162 25194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:20.837105 25192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:20.839093 25186 server_base.cc:1034] running on GCE node
I20260805 23:00:20.840175 25186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:20.841969 25186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:20.843248 25186 hybrid_clock.cc:648] HybridClock initialized: now 1785970820843163 us; error 58 us; skew 500 ppm
I20260805 23:00:20.843644 25186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:20 dist-test-slave-1vmg krb5kdc[25167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970820, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:20.847788 25186 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:20.849710 25186 webserver.cc:460] Webserver started at http://127.22.45.126:33819/ using document root <none> and password file <none>
I20260805 23:00:20.850581 25186 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:20.850713 25186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:20.851142 25186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:20.854709 25186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "01d09ad5f8c441d8a8b4b961e8f46b73"
format_stamp: "Formatted at 2026-08-05 23:00:20 on dist-test-slave-1vmg"
server_key: "97e613dc0038154f77fd5a7b64873599"
server_key_iv: "f6a777c6d9e413731630ad1aee9f606d"
server_key_version: "encryptionkey@0"
I20260805 23:00:20.855780 25186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "01d09ad5f8c441d8a8b4b961e8f46b73"
format_stamp: "Formatted at 2026-08-05 23:00:20 on dist-test-slave-1vmg"
server_key: "97e613dc0038154f77fd5a7b64873599"
server_key_iv: "f6a777c6d9e413731630ad1aee9f606d"
server_key_version: "encryptionkey@0"
I20260805 23:00:20.862274 25186 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:20.866714 25209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:20.868417 25186 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:00:20.868635 25186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "01d09ad5f8c441d8a8b4b961e8f46b73"
format_stamp: "Formatted at 2026-08-05 23:00:20 on dist-test-slave-1vmg"
server_key: "97e613dc0038154f77fd5a7b64873599"
server_key_iv: "f6a777c6d9e413731630ad1aee9f606d"
server_key_version: "encryptionkey@0"
I20260805 23:00:20.868891 25186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:20.897104 25186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:20.901717 25186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:20.902004 25186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:20.925920 25186 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:38041
I20260805 23:00:20.925930 25303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:38041 every 8 connection(s)
I20260805 23:00:20.927644 25186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:20.932602 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 25186
I20260805 23:00:20.932955 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:20.933089 25306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:20.933991 22709 external_mini_cluster.cc:1428] Setting key bdcc39f62a123f655dd770514ead1fb3
I20260805 23:00:20.949922 25306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Bootstrap starting.
Aug 05 23:00:20 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:20.953701 25306 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:20.955255 25306 log.cc:824] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:20.959126 25306 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: No bootstrap required, opened a new log
I20260805 23:00:20.963145 25312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:20.936876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41454 (local address 127.22.45.126:38041)
0805 23:00:20.938672 (+ 1796us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:20.938690 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:20.939302 (+ 612us) server_negotiation.cc:407] Connection header received
0805 23:00:20.941417 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:20.941456 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:20.942149 (+ 693us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:20.942711 (+ 562us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:20.944282 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:20.946361 (+ 2079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:20.947935 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:20.949060 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:20.949266 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:20.953972 (+ 4706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:20.953985 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:20.954009 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:20.954073 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:20.958215 (+ 4142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:20.959084 (+ 869us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:20.959095 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:20.959108 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:20.959329 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:20.959703 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:20.959708 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:20.959710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:20.960449 (+ 739us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:20.960779 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:20.961084 (+ 305us) server_negotiation.cc:299] Negotiation successful
0805 23:00:20.961597 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1483,"thread_start_us":1164,"threads_started":1}
I20260805 23:00:20.968250 25306 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38041 } }
I20260805 23:00:20.968626 25306 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:20.968730 25306 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01d09ad5f8c441d8a8b4b961e8f46b73, State: Initialized, Role: FOLLOWER
I20260805 23:00:20.969348 25306 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38041 } }
I20260805 23:00:20.969575 25306 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:20.969707 25306 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:20.969872 25306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:20.972348 25306 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38041 } }
I20260805 23:00:20.972965 25306 leader_election.cc:302] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01d09ad5f8c441d8a8b4b961e8f46b73; no voters:
I20260805 23:00:20.973665 25306 leader_election.cc:288] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:20.973802 25314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:20.975154 25314 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [term 1 LEADER]: Becoming Leader. State: Replica: 01d09ad5f8c441d8a8b4b961e8f46b73, State: Running, Role: LEADER
I20260805 23:00:20.975829 25314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38041 } }
I20260805 23:00:20.976209 25306 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:20.979094 25317 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38041 } } }
I20260805 23:00:20.979195 25318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01d09ad5f8c441d8a8b4b961e8f46b73. Latest consensus state: current_term: 1 leader_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01d09ad5f8c441d8a8b4b961e8f46b73" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38041 } } }
I20260805 23:00:20.979544 25318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:20.979552 25317 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:20.987977 25326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:20.994225 25326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:21.004805 25326 catalog_manager.cc:1347] Generated new cluster ID: 718f8d22991d4865a93d26e8fcdc93d2
I20260805 23:00:21.004959 25326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:21.026418 25326 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:21.028537 25326 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:21.056141 25326 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Generated new TSK 0
I20260805 23:00:21.057422 25326 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:21.124521 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38041
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:21.503660 25342 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:21.504038 25342 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:21.504207 25342 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:21.511981 25342 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:21.512178 25342 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:21.512315 25342 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 23:00:21.512394 25342 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:00:21.512516 25342 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:21.523162 25342 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:21.524730 25342 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:21.526289 25342 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:21.541625 25354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:21.541661 25349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:21.541702 25347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:21.542701 25342 server_base.cc:1034] running on GCE node
I20260805 23:00:21.543447 25342 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:21.544529 25342 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:21.545791 25342 hybrid_clock.cc:648] HybridClock initialized: now 1785970821545734 us; error 52 us; skew 500 ppm
I20260805 23:00:21.546195 25342 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:21 dist-test-slave-1vmg krb5kdc[25167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970821, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:21.553258 25342 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:21.555213 25342 webserver.cc:460] Webserver started at http://127.22.45.65:38313/ using document root <none> and password file <none>
I20260805 23:00:21.556080 25342 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:21.556238 25342 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:21.556625 25342 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:21.560362 25342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "26018b8a994642d485272abc41b4ce2f"
format_stamp: "Formatted at 2026-08-05 23:00:21 on dist-test-slave-1vmg"
server_key: "aca29f9cf52429914b8bb2ec10feb0c5"
server_key_iv: "544895233c8b23ab612c15be96506e37"
server_key_version: "encryptionkey@0"
I20260805 23:00:21.561271 25342 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "26018b8a994642d485272abc41b4ce2f"
format_stamp: "Formatted at 2026-08-05 23:00:21 on dist-test-slave-1vmg"
server_key: "aca29f9cf52429914b8bb2ec10feb0c5"
server_key_iv: "544895233c8b23ab612c15be96506e37"
server_key_version: "encryptionkey@0"
I20260805 23:00:21.567474 25342 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 23:00:21.571620 25365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:21.573660 25342 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:00:21.573904 25342 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "26018b8a994642d485272abc41b4ce2f"
format_stamp: "Formatted at 2026-08-05 23:00:21 on dist-test-slave-1vmg"
server_key: "aca29f9cf52429914b8bb2ec10feb0c5"
server_key_iv: "544895233c8b23ab612c15be96506e37"
server_key_version: "encryptionkey@0"
I20260805 23:00:21.574170 25342 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:21.588653 25342 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:21.593331 25342 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:21.593631 25342 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:21.596557 25342 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:21.596673 25342 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:21.596789 25342 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:21.596879 25342 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:00:21 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970821, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:21.624871 25382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:21.597190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:49091 (local address 127.22.45.126:38041)
0805 23:00:21.597790 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:21.597798 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:21.598983 (+ 1185us) server_negotiation.cc:407] Connection header received
0805 23:00:21.602112 (+ 3129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:21.602119 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:21.602237 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:21.602341 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:21.605722 (+ 3381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.606696 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.609834 (+ 3138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.610368 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.610524 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:21.616297 (+ 5773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:21.616306 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:21.616310 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:21.616362 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:21.620074 (+ 3712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:21.621214 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:21.621222 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:21.621227 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:21.621410 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:21.622161 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:21.622167 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:21.622172 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:21.622609 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:21.622798 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:21.624107 (+ 1309us) server_negotiation.cc:299] Negotiation successful
0805 23:00:21.624441 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":329,"threads_started":1}
I20260805 23:00:21.627014 25383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:21.597840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38041 (local address 127.22.45.65:49091)
0805 23:00:21.598749 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:21.598808 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:21.601643 (+ 2835us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:21.603048 (+ 1405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:21.603064 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:21.604142 (+ 1078us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:21.605413 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:21.605450 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.606981 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.606987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:21.609603 (+ 2616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:21.609627 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.610665 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.610674 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:21.611134 (+ 460us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:21.612082 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:21.612109 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:21.615881 (+ 3772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:21.620302 (+ 4421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:21.620318 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:21.620347 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:21.621016 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:21.621573 (+ 557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:21.621583 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:21.621587 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:21.621981 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:21.622794 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:21.622802 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:21.623475 (+ 673us) client_negotiation.cc:769] Sending connection context
0805 23:00:21.623943 (+ 468us) client_negotiation.cc:240] Negotiation successful
0805 23:00:21.624811 (+ 868us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":356,"threads_started":1}
I20260805 23:00:21.638134 25342 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:39203
I20260805 23:00:21.638211 25539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:39203 every 8 connection(s)
I20260805 23:00:21.639776 25342 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:21.640333 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 25342
I20260805 23:00:21.640549 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:21.641384 22709 external_mini_cluster.cc:1428] Setting key 8688b5b6df0e03bb61a198c63ad49aef
I20260805 23:00:21.643729 25540 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38041
I20260805 23:00:21.644030 25540 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:21.644963 25540 heartbeater.cc:511] Master 127.22.45.126:38041 requested a full tablet report, sending...
I20260805 23:00:21.647503 25236 ts_manager.cc:194] Registered new tserver with Master: 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203)
I20260805 23:00:21.649317 25236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:49091
I20260805 23:00:21.654515 25382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:21.636648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:39181 (local address 127.22.45.126:38041)
0805 23:00:21.636884 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:21.636892 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:21.639642 (+ 2750us) server_negotiation.cc:407] Connection header received
0805 23:00:21.639792 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:21.639798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:21.639897 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:21.640015 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:21.641757 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.642837 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.645317 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.645959 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.646112 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:21.648454 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:21.648465 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:21.648469 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:21.648513 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:21.651765 (+ 3252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:21.652679 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:21.652685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:21.652688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:21.652856 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:21.653259 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:21.653262 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:21.653264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:21.653529 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:21.653674 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:21.654087 (+ 413us) server_negotiation.cc:299] Negotiation successful
0805 23:00:21.654270 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:00:21.654794 25534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:21.636605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38041 (local address 127.22.45.65:39181)
0805 23:00:21.639480 (+ 2875us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:21.639502 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:21.639657 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:21.640216 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:21.640221 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:21.641007 (+ 786us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:21.641493 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:21.641510 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.643520 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.643525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:21.645135 (+ 1610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:21.645153 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:21.646158 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:21.646165 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:21.646345 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:21.647107 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:21.647132 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:21.648194 (+ 1062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:21.651939 (+ 3745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:21.651945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:21.651950 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:21.652507 (+ 557us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:21.652980 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:21.652985 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:21.652989 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:21.653160 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:21.653656 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:21.653661 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:21.653854 (+ 193us) client_negotiation.cc:769] Sending connection context
0805 23:00:21.653999 (+ 145us) client_negotiation.cc:240] Negotiation successful
0805 23:00:21.654342 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2704,"thread_start_us":2517,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:21.695408 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38041
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:22.070991 25546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:22.071472 25546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:22.071659 25546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:22.080958 25546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:22.081157 25546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:22.081314 25546 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 23:00:22.081405 25546 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:00:22.081519 25546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:22.093078 25546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:22.094705 25546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:22.096336 25546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:22.111781 25554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:22.111824 25552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:22.111734 25559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:22.112761 25546 server_base.cc:1034] running on GCE node
I20260805 23:00:22.113507 25546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:22.114714 25546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:22.115973 25546 hybrid_clock.cc:648] HybridClock initialized: now 1785970822115905 us; error 59 us; skew 500 ppm
I20260805 23:00:22.116384 25546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:22 dist-test-slave-1vmg krb5kdc[25167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970822, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:22.121042 25546 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:22.122835 25546 webserver.cc:460] Webserver started at http://127.22.45.66:35389/ using document root <none> and password file <none>
I20260805 23:00:22.123683 25546 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:22.123836 25546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:22.124244 25546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:22.127795 25546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "d04f9bf5e5534b869f01b5e73ce2a767"
format_stamp: "Formatted at 2026-08-05 23:00:22 on dist-test-slave-1vmg"
server_key: "2b69eae3c43f032f2ee4ede19bc59929"
server_key_iv: "d843f592e217f006c107077bdec520e3"
server_key_version: "encryptionkey@0"
I20260805 23:00:22.128835 25546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "d04f9bf5e5534b869f01b5e73ce2a767"
format_stamp: "Formatted at 2026-08-05 23:00:22 on dist-test-slave-1vmg"
server_key: "2b69eae3c43f032f2ee4ede19bc59929"
server_key_iv: "d843f592e217f006c107077bdec520e3"
server_key_version: "encryptionkey@0"
I20260805 23:00:22.135493 25546 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 23:00:22.139935 25567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:22.141899 25546 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:00:22.142155 25546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "d04f9bf5e5534b869f01b5e73ce2a767"
format_stamp: "Formatted at 2026-08-05 23:00:22 on dist-test-slave-1vmg"
server_key: "2b69eae3c43f032f2ee4ede19bc59929"
server_key_iv: "d843f592e217f006c107077bdec520e3"
server_key_version: "encryptionkey@0"
I20260805 23:00:22.142400 25546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:22.175297 25546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:22.181485 25546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:22.181967 25546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:22.185843 25546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:22.186002 25546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:22.186143 25546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:22.186233 25546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:00:22 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970822, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:22.213459 25583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.187257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:35229 (local address 127.22.45.126:38041)
0805 23:00:22.190487 (+ 3230us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.190496 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.190539 (+ 43us) server_negotiation.cc:407] Connection header received
0805 23:00:22.192448 (+ 1909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.192455 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.192578 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.192678 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:22.195369 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.196476 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.198993 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.199699 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.199862 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.205675 (+ 5813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:22.205685 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:22.205690 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:22.205744 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:22.209003 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.210405 (+ 1402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.210411 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.210413 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.210561 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.211294 (+ 733us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.211300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.211303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.211636 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:22.211757 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.212931 (+ 1174us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.213157 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2958,"thread_start_us":2815,"threads_started":1}
I20260805 23:00:22.215560 25584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.187957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38041 (local address 127.22.45.66:35229)
0805 23:00:22.189203 (+ 1246us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:22.189268 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:22.192021 (+ 2753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:22.193021 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:22.193033 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:22.194006 (+ 973us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:22.195043 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.195081 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.196715 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.196721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.198763 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.198780 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.200025 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.200035 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.200313 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.201182 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:22.201222 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:22.205287 (+ 4065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:22.209241 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.209255 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.209292 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.210225 (+ 933us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.210681 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.210686 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.210691 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.211145 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.211775 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:22.211786 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:22.212402 (+ 616us) client_negotiation.cc:769] Sending connection context
0805 23:00:22.212762 (+ 360us) client_negotiation.cc:240] Negotiation successful
0805 23:00:22.213447 (+ 685us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":867,"thread_start_us":514,"threads_started":1}
I20260805 23:00:22.239400 25546 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:42809
I20260805 23:00:22.239526 25740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:42809 every 8 connection(s)
I20260805 23:00:22.241153 25546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:22.242003 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 25546
I20260805 23:00:22.242188 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:22.242765 22709 external_mini_cluster.cc:1428] Setting key 0143c0c9ee15290504cec7cbb1efb303
I20260805 23:00:22.247009 25741 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38041
I20260805 23:00:22.247349 25741 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:22.248283 25741 heartbeater.cc:511] Master 127.22.45.126:38041 requested a full tablet report, sending...
I20260805 23:00:22.250592 25583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.230267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:52461 (local address 127.22.45.126:38041)
0805 23:00:22.230530 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.230538 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.235930 (+ 5392us) server_negotiation.cc:407] Connection header received
0805 23:00:22.236103 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.236116 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.236224 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.236355 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:22.237816 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.239021 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.240761 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.241406 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.241584 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.244177 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:22.244185 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:22.244189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:22.244247 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:22.247677 (+ 3430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.248448 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.248454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.248458 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.248594 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.248976 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.248981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.248985 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.249444 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:22.249610 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.250001 (+ 391us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.250239 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 23:00:22.250684 25719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.230274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38041 (local address 127.22.45.66:52461)
0805 23:00:22.235758 (+ 5484us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:22.235783 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:22.235966 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:22.236430 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:22.236436 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:22.237159 (+ 723us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:22.237601 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.237615 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.239219 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.239226 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.240563 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.240582 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.241661 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.241669 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.241863 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.242637 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:22.242663 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:22.243908 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:22.247843 (+ 3935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.247850 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.247855 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.248317 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.248713 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.248719 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.248723 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.248863 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.249561 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:22.249566 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:22.249755 (+ 189us) client_negotiation.cc:769] Sending connection context
0805 23:00:22.249887 (+ 132us) client_negotiation.cc:240] Negotiation successful
0805 23:00:22.250262 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5280,"thread_start_us":4994,"threads_started":1}
I20260805 23:00:22.251266 25236 ts_manager.cc:194] Registered new tserver with Master: d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:22.252184 25236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:35229
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:22.295579 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38041
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:00:22.653249 25540 heartbeater.cc:503] Master 127.22.45.126:38041 was elected leader, sending a full tablet report...
W20260805 23:00:22.659420 25749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:22.659796 25749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:22.659947 25749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:22.667860 25749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:22.668033 25749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:22.668170 25749 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260805 23:00:22.668244 25749 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:00:22.668359 25749 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:22.679446 25749 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38041
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:22.680998 25749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:22.682513 25749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:22.696825 25760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:22.696861 25758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:22.697182 25757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:22.698251 25749 server_base.cc:1034] running on GCE node
I20260805 23:00:22.699093 25749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:22.700244 25749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:22.701512 25749 hybrid_clock.cc:648] HybridClock initialized: now 1785970822701440 us; error 72 us; skew 500 ppm
I20260805 23:00:22.701896 25749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:22 dist-test-slave-1vmg krb5kdc[25167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970822, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:22.705554 25749 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:22.707448 25749 webserver.cc:460] Webserver started at http://127.22.45.67:42637/ using document root <none> and password file <none>
I20260805 23:00:22.708245 25749 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:22.708384 25749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:22.708737 25749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:22.712321 25749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "e5c22c256bc445d9a9ca9e0389cab403"
format_stamp: "Formatted at 2026-08-05 23:00:22 on dist-test-slave-1vmg"
server_key: "ba448eadfc6fb4dd4d4a7ee5602a400c"
server_key_iv: "b5e7e19307aa7cfe23122ccf04f7167a"
server_key_version: "encryptionkey@0"
I20260805 23:00:22.713475 25749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "e5c22c256bc445d9a9ca9e0389cab403"
format_stamp: "Formatted at 2026-08-05 23:00:22 on dist-test-slave-1vmg"
server_key: "ba448eadfc6fb4dd4d4a7ee5602a400c"
server_key_iv: "b5e7e19307aa7cfe23122ccf04f7167a"
server_key_version: "encryptionkey@0"
I20260805 23:00:22.720610 25749 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260805 23:00:22.724915 25768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:22.726701 25749 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:00:22.727013 25749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "e5c22c256bc445d9a9ca9e0389cab403"
format_stamp: "Formatted at 2026-08-05 23:00:22 on dist-test-slave-1vmg"
server_key: "ba448eadfc6fb4dd4d4a7ee5602a400c"
server_key_iv: "b5e7e19307aa7cfe23122ccf04f7167a"
server_key_version: "encryptionkey@0"
I20260805 23:00:22.727262 25749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:22.749935 25749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:22.754797 25749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:22.755153 25749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:22.758307 25749 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:22.758447 25749 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:22.758580 25749 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:22.758661 25749 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:00:22 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970822, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:22.787019 25781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.759095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:44411 (local address 127.22.45.126:38041)
0805 23:00:22.759782 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.759789 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.761228 (+ 1439us) server_negotiation.cc:407] Connection header received
0805 23:00:22.763734 (+ 2506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.763742 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.763856 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.763933 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:22.766822 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.768171 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.770726 (+ 2555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.771390 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.771542 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.777608 (+ 6066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:22.777615 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:22.777619 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:22.777661 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:22.781123 (+ 3462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.782650 (+ 1527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.782659 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.782663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.782891 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.783935 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.783944 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.783947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.784672 (+ 725us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:22.784863 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.785828 (+ 965us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.786154 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":390,"threads_started":1}
I20260805 23:00:22.788949 25782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.759921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38041 (local address 127.22.45.67:44411)
0805 23:00:22.760972 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:22.761040 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:22.763262 (+ 2222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:22.764567 (+ 1305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:22.764577 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:22.765558 (+ 981us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:22.766531 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.766561 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.768422 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.768429 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.770456 (+ 2027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.770487 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.771776 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.771788 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.772254 (+ 466us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.773306 (+ 1052us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:22.773354 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:22.777247 (+ 3893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:22.781424 (+ 4177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.781440 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.781468 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.782434 (+ 966us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.783126 (+ 692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.783130 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.783133 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.783613 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.784896 (+ 1283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:22.784908 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:22.785390 (+ 482us) client_negotiation.cc:769] Sending connection context
0805 23:00:22.785702 (+ 312us) client_negotiation.cc:240] Negotiation successful
0805 23:00:22.786500 (+ 798us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":438,"threads_started":1}
I20260805 23:00:22.814113 25749 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:35897
I20260805 23:00:22.814152 25929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:35897 every 8 connection(s)
I20260805 23:00:22.815801 25749 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:22.817408 25781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.795825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:37119 (local address 127.22.45.126:38041)
0805 23:00:22.796062 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.796069 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.803162 (+ 7093us) server_negotiation.cc:407] Connection header received
0805 23:00:22.803411 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.803418 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.803519 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.803631 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:22.804797 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.805694 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.807761 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.808333 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.808461 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.811412 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:22.811418 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:22.811421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:22.811458 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:22.814363 (+ 2905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.815198 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.815202 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.815205 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.815338 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.815730 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.815733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.815735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.816043 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:22.816176 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.816741 (+ 565us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.817004 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 23:00:22.817518 25867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.795781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38041 (local address 127.22.45.67:37119)
0805 23:00:22.802904 (+ 7123us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:22.802973 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:22.803236 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:22.803698 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:22.803703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:22.804274 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:22.804604 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.804615 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.805882 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.805888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.807531 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.807547 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.808752 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.808760 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.809072 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.809868 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:22.809896 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:22.811147 (+ 1251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:22.814496 (+ 3349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.814501 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.814504 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.815085 (+ 581us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.815450 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:22.815455 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:22.815458 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:22.815614 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:22.816155 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:22.816160 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:22.816400 (+ 240us) client_negotiation.cc:769] Sending connection context
0805 23:00:22.816568 (+ 168us) client_negotiation.cc:240] Negotiation successful
0805 23:00:22.816995 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6828,"thread_start_us":6697,"threads_started":1}
I20260805 23:00:22.818567 25931 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38041
I20260805 23:00:22.819193 25931 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:22.820041 25931 heartbeater.cc:511] Master 127.22.45.126:38041 requested a full tablet report, sending...
I20260805 23:00:22.821353 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 25749
I20260805 23:00:22.821544 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:22.821768 25236 ts_manager.cc:194] Registered new tserver with Master: e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897)
I20260805 23:00:22.822149 22709 external_mini_cluster.cc:1428] Setting key 906ea487d6459ef7676054cf4a006a26
I20260805 23:00:22.822744 25236 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:44411
I20260805 23:00:22.825299 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 23:00:22 dist-test-slave-1vmg krb5kdc[25167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 23:00:22 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:22.881471 25781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.865838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41464 (local address 127.22.45.126:38041)
0805 23:00:22.866062 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.866069 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.866222 (+ 153us) server_negotiation.cc:407] Connection header received
0805 23:00:22.866429 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.866434 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.866503 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.866609 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:22.868180 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.868904 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.870209 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.870655 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.870776 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.875491 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:22.875497 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:22.875501 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:22.875548 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:22.878515 (+ 2967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.879513 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.879519 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.879522 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.879687 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:22.880108 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:22.880112 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:22.880114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:22.880428 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:22.880669 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.880944 (+ 275us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.881206 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:00:22.886988 25236 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:22.895272 25236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:22.936504 25954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.911387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:35897 (local address 127.0.0.1:42910)
0805 23:00:22.922249 (+ 10862us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:22.922300 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:22.922575 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:22.925010 (+ 2435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:22.925019 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:22.925050 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:22.925655 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.925672 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.928292 (+ 2620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.928300 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.932155 (+ 3855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.932324 (+ 169us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.935277 (+ 2953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.935284 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.935569 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.935633 (+ 64us) client_negotiation.cc:769] Sending connection context
0805 23:00:22.935775 (+ 142us) client_negotiation.cc:240] Negotiation successful
0805 23:00:22.936058 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10537,"thread_start_us":12036,"threads_started":1}
I20260805 23:00:22.937466 25953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.911985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42910 (local address 127.22.45.67:35897)
0805 23:00:22.924207 (+ 12222us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.924217 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.924257 (+ 40us) server_negotiation.cc:407] Connection header received
0805 23:00:22.924375 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.924384 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.924706 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.924947 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:22.925947 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.928007 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.932692 (+ 4685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.934605 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.934766 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.935109 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.936863 (+ 1754us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.937091 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12009,"thread_start_us":12001,"threads_started":1}
I20260805 23:00:22.944682 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.916103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56714 (local address 127.22.45.65:39203)
0805 23:00:22.930995 (+ 14892us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.931009 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.931061 (+ 52us) server_negotiation.cc:407] Connection header received
0805 23:00:22.931223 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.931236 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.932236 (+ 1000us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.933751 (+ 1515us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:22.934053 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.935567 (+ 1514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.940105 (+ 4538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.942359 (+ 2254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.943549 (+ 1190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.943895 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.944021 (+ 126us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.944288 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14581,"thread_start_us":15483,"threads_started":1}
I20260805 23:00:22.943728 25837 tablet_service.cc:1467] Processing CreateTablet for tablet edd3f0ef71e84b3ca6fa3717c679daa8 (DEFAULT_TABLE table=test-table [id=b915391b36574ae095af2cb2311131d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:22.946075 25949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.915721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39203 (local address 127.0.0.1:56714)
0805 23:00:22.924694 (+ 8973us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:22.924718 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:22.924838 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:22.932590 (+ 7752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:22.932596 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:22.932727 (+ 131us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:22.933406 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.933430 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.935764 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.935769 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.939816 (+ 4047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.939832 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.942865 (+ 3033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.942872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.943181 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.943245 (+ 64us) client_negotiation.cc:769] Sending connection context
0805 23:00:22.943375 (+ 130us) client_negotiation.cc:240] Negotiation successful
0805 23:00:22.945569 (+ 2194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8812,"mutex_wait_us":1958,"thread_start_us":5920,"threads_started":1}
I20260805 23:00:22.946202 25837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edd3f0ef71e84b3ca6fa3717c679daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:22.949059 25948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.911472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:42809 (local address 127.0.0.1:44340)
0805 23:00:22.923766 (+ 12294us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:22.923790 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:22.923933 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:22.939563 (+ 15630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:22.939569 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:22.939604 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:22.940064 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.940076 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.942730 (+ 2654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.942740 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.945176 (+ 2436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:22.945206 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.948295 (+ 3089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.948304 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:22.948485 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.948522 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 23:00:22.948598 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 23:00:22.948743 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12123,"mutex_wait_us":1,"thread_start_us":12935,"threads_started":1}
I20260805 23:00:22.950328 25952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:22.911672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44340 (local address 127.22.45.66:42809)
0805 23:00:22.938743 (+ 27071us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:22.938752 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:22.938789 (+ 37us) server_negotiation.cc:407] Connection header received
0805 23:00:22.938944 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:22.938955 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:22.939303 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:22.940309 (+ 1006us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:22.940553 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.942395 (+ 1842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.945635 (+ 3240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:22.947876 (+ 2241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:22.949396 (+ 1520us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:22.949679 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:22.949778 (+ 99us) server_negotiation.cc:299] Negotiation successful
0805 23:00:22.949997 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26849,"thread_start_us":27403,"threads_started":1}
I20260805 23:00:22.951845 25438 tablet_service.cc:1467] Processing CreateTablet for tablet edd3f0ef71e84b3ca6fa3717c679daa8 (DEFAULT_TABLE table=test-table [id=b915391b36574ae095af2cb2311131d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:22.954555 25640 tablet_service.cc:1467] Processing CreateTablet for tablet edd3f0ef71e84b3ca6fa3717c679daa8 (DEFAULT_TABLE table=test-table [id=b915391b36574ae095af2cb2311131d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:22.955225 25438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edd3f0ef71e84b3ca6fa3717c679daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:22.956132 25640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet edd3f0ef71e84b3ca6fa3717c679daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:22.969596 25958 tablet_bootstrap.cc:492] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Bootstrap starting.
I20260805 23:00:22.971685 25960 tablet_bootstrap.cc:492] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Bootstrap starting.
I20260805 23:00:22.973999 25958 tablet_bootstrap.cc:654] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:22.975221 25958 log.cc:824] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:22.975761 25960 tablet_bootstrap.cc:654] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:22.976312 25961 tablet_bootstrap.cc:492] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Bootstrap starting.
I20260805 23:00:22.977558 25960 log.cc:824] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:22.981098 25961 tablet_bootstrap.cc:654] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:22.982501 25958 tablet_bootstrap.cc:492] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: No bootstrap required, opened a new log
I20260805 23:00:22.982671 25961 log.cc:824] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:22.982775 25960 tablet_bootstrap.cc:492] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: No bootstrap required, opened a new log
I20260805 23:00:22.982822 25958 ts_tablet_manager.cc:1397] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260805 23:00:22.983127 25960 ts_tablet_manager.cc:1397] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.005s
I20260805 23:00:22.986529 25961 tablet_bootstrap.cc:492] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: No bootstrap required, opened a new log
I20260805 23:00:22.986903 25961 ts_tablet_manager.cc:1397] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260805 23:00:22.991711 25958 raft_consensus.cc:348] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:22.992188 25958 raft_consensus.cc:374] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:22.992295 25958 raft_consensus.cc:729] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Initialized, Role: FOLLOWER
I20260805 23:00:22.992974 25958 consensus_queue.cc:260] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:22.994253 25931 heartbeater.cc:503] Master 127.22.45.126:38041 was elected leader, sending a full tablet report...
I20260805 23:00:22.994216 25960 raft_consensus.cc:348] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:22.994778 25960 raft_consensus.cc:374] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:22.994879 25960 raft_consensus.cc:729] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04f9bf5e5534b869f01b5e73ce2a767, State: Initialized, Role: FOLLOWER
I20260805 23:00:22.995095 25958 ts_tablet_manager.cc:1428] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260805 23:00:22.995775 25960 consensus_queue.cc:260] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:22.997128 25741 heartbeater.cc:503] Master 127.22.45.126:38041 was elected leader, sending a full tablet report...
I20260805 23:00:22.997700 25960 ts_tablet_manager.cc:1428] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Time spent starting tablet: real 0.014s user 0.012s sys 0.001s
I20260805 23:00:22.998960 25961 raft_consensus.cc:348] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:22.999509 25961 raft_consensus.cc:374] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:22.999635 25961 raft_consensus.cc:729] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26018b8a994642d485272abc41b4ce2f, State: Initialized, Role: FOLLOWER
I20260805 23:00:23.000442 25961 consensus_queue.cc:260] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:23.002707 25961 ts_tablet_manager.cc:1428] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Time spent starting tablet: real 0.016s user 0.009s sys 0.004s
W20260805 23:00:23.069180 25934 tablet.cc:2369] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:00:23.144259 25541 tablet.cc:2369] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:00:23.175644 25968 raft_consensus.cc:482] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:23.176162 25968 raft_consensus.cc:504] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:23.178810 25968 leader_election.cc:288] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897), 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203)
I20260805 23:00:23.187261 25953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.179494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:48493 (local address 127.22.45.67:35897)
0805 23:00:23.179685 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.179691 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.180683 (+ 992us) server_negotiation.cc:407] Connection header received
0805 23:00:23.181210 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.181219 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.181410 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.181556 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:23.182529 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.183306 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.185308 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.186151 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.186336 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.186424 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.186794 (+ 370us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.186980 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 23:00:23.187415 25957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.179389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:45755 (local address 127.22.45.65:39203)
0805 23:00:23.179634 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.179640 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.180691 (+ 1051us) server_negotiation.cc:407] Connection header received
0805 23:00:23.181241 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.181248 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.181352 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.181451 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:23.182323 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.183130 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.185324 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.186178 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.186346 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.186430 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.186997 (+ 567us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.187154 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 23:00:23.187517 25972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.179164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39203 (local address 127.22.45.66:45755)
0805 23:00:23.180405 (+ 1241us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:23.180428 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:23.180912 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:23.181558 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:23.181574 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:23.181614 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:23.182107 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.182123 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.183314 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.183320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.185102 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.185123 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.186443 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.186450 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.186663 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.186793 (+ 130us) client_negotiation.cc:769] Sending connection context
0805 23:00:23.186903 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 23:00:23.187080 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1074,"mutex_wait_us":59,"thread_start_us":1274,"threads_started":1}
I20260805 23:00:23.187909 25971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.179299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:35897 (local address 127.22.45.66:48493)
0805 23:00:23.180456 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:23.180471 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:23.180912 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:23.181871 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:23.181875 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:23.181898 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:23.182354 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.182365 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.183457 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.183465 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.185107 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.185124 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.186414 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.186424 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.186601 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.186647 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 23:00:23.186741 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 23:00:23.186894 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":68,"spinlock_wait_cycles":101248,"thread_start_us":639,"threads_started":1}
I20260805 23:00:23.188832 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edd3f0ef71e84b3ca6fa3717c679daa8" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f" is_pre_election: true
I20260805 23:00:23.189033 25869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edd3f0ef71e84b3ca6fa3717c679daa8" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c22c256bc445d9a9ca9e0389cab403" is_pre_election: true
I20260805 23:00:23.189391 25467 raft_consensus.cc:2454] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 0.
I20260805 23:00:23.189589 25869 raft_consensus.cc:2454] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 0.
I20260805 23:00:23.190140 25570 leader_election.cc:302] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26018b8a994642d485272abc41b4ce2f, d04f9bf5e5534b869f01b5e73ce2a767; no voters:
I20260805 23:00:23.190559 25968 raft_consensus.cc:2781] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:23.190714 25968 raft_consensus.cc:482] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:23.190832 25968 raft_consensus.cc:3037] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:23.193328 25968 raft_consensus.cc:504] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:23.194028 25968 leader_election.cc:288] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 election: Requested vote from peers e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897), 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203)
I20260805 23:00:23.194756 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edd3f0ef71e84b3ca6fa3717c679daa8" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f"
I20260805 23:00:23.194756 25869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "edd3f0ef71e84b3ca6fa3717c679daa8" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c22c256bc445d9a9ca9e0389cab403"
I20260805 23:00:23.195025 25467 raft_consensus.cc:3037] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:23.195027 25869 raft_consensus.cc:3037] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:23.197487 25869 raft_consensus.cc:2454] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 1.
I20260805 23:00:23.197577 25467 raft_consensus.cc:2454] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 1.
I20260805 23:00:23.198076 25574 leader_election.cc:302] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 26018b8a994642d485272abc41b4ce2f, d04f9bf5e5534b869f01b5e73ce2a767, e5c22c256bc445d9a9ca9e0389cab403; no voters:
I20260805 23:00:23.198505 25968 raft_consensus.cc:2781] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:23.199214 25968 raft_consensus.cc:686] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 LEADER]: Becoming Leader. State: Replica: d04f9bf5e5534b869f01b5e73ce2a767, State: Running, Role: LEADER
I20260805 23:00:23.199853 25968 consensus_queue.cc:237] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } }
I20260805 23:00:23.205924 25237 catalog_manager.cc:5495] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 reported cstate change: term changed from 0 to 1, leader changed from <none> to d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } health_report { overall_health: UNKNOWN } } }
W20260805 23:00:23.247648 25742 tablet.cc:2369] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 05 23:00:23 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970820, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:23.277843 25983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.262220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38041 (local address 127.0.0.1:41478)
0805 23:00:23.263071 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:23.263091 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:23.263264 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:23.263586 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:23.263590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:23.264405 (+ 815us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:23.264691 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.264702 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.265983 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.265990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.267303 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.267328 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.268419 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.268425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.268573 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.269342 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:23.269361 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:23.271832 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:23.275239 (+ 3407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:23.275254 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:23.275261 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:23.275730 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:23.276118 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:23.276122 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:23.276124 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:23.276272 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:23.276894 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:23.276901 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:23.277076 (+ 175us) client_negotiation.cc:769] Sending connection context
0805 23:00:23.277215 (+ 139us) client_negotiation.cc:240] Negotiation successful
0805 23:00:23.277483 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":473,"threads_started":1}
I20260805 23:00:23.277909 25781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.262167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41478 (local address 127.22.45.126:38041)
0805 23:00:23.262492 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.262499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.263191 (+ 692us) server_negotiation.cc:407] Connection header received
0805 23:00:23.263363 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.263367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.263446 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.263545 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:23.264908 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.265704 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.267555 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.268144 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.268276 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.272096 (+ 3820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:23.272102 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:23.272106 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:23.272139 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:23.275062 (+ 2923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:23.275868 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:23.275872 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:23.275875 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:23.276011 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:23.276416 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:23.276419 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:23.276421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:23.276742 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:23.276870 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.277319 (+ 449us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.277615 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":77,"server-negotiator.queue_time_us":137}
I20260805 23:00:23.283241 25237 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:41478:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 23:00:23.284327 25237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:23.292171 25640 tablet_service.cc:1467] Processing CreateTablet for tablet 10dbbf78af3f43b9b31dad5eeb90909a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4eb9bc6112784149aba5e2474813d6f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:00:23.292132 25438 tablet_service.cc:1467] Processing CreateTablet for tablet 10dbbf78af3f43b9b31dad5eeb90909a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4eb9bc6112784149aba5e2474813d6f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:00:23.292326 25837 tablet_service.cc:1467] Processing CreateTablet for tablet 10dbbf78af3f43b9b31dad5eeb90909a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4eb9bc6112784149aba5e2474813d6f7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:00:23.293145 25640 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10dbbf78af3f43b9b31dad5eeb90909a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:23.293149 25438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10dbbf78af3f43b9b31dad5eeb90909a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:23.293149 25837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10dbbf78af3f43b9b31dad5eeb90909a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:23.298880 25960 tablet_bootstrap.cc:492] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: Bootstrap starting.
I20260805 23:00:23.300808 25960 tablet_bootstrap.cc:654] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:23.300915 25958 tablet_bootstrap.cc:492] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: Bootstrap starting.
I20260805 23:00:23.301548 25961 tablet_bootstrap.cc:492] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: Bootstrap starting.
I20260805 23:00:23.302572 25958 tablet_bootstrap.cc:654] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:23.303197 25961 tablet_bootstrap.cc:654] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:23.303486 25960 tablet_bootstrap.cc:492] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: No bootstrap required, opened a new log
I20260805 23:00:23.303682 25960 ts_tablet_manager.cc:1397] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260805 23:00:23.304533 25960 raft_consensus.cc:348] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.304838 25960 raft_consensus.cc:374] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:23.304943 25960 raft_consensus.cc:729] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04f9bf5e5534b869f01b5e73ce2a767, State: Initialized, Role: FOLLOWER
I20260805 23:00:23.305236 25960 consensus_queue.cc:260] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.305683 25958 tablet_bootstrap.cc:492] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: No bootstrap required, opened a new log
I20260805 23:00:23.305850 25958 ts_tablet_manager.cc:1397] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260805 23:00:23.305735 25968 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.306034 25968 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:23.306439 25961 tablet_bootstrap.cc:492] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: No bootstrap required, opened a new log
I20260805 23:00:23.306607 25960 ts_tablet_manager.cc:1428] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260805 23:00:23.307017 25958 raft_consensus.cc:348] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.307207 25961 ts_tablet_manager.cc:1397] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260805 23:00:23.307343 25958 raft_consensus.cc:374] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:23.307449 25958 raft_consensus.cc:729] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Initialized, Role: FOLLOWER
I20260805 23:00:23.308288 25961 raft_consensus.cc:348] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.308575 25961 raft_consensus.cc:374] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:23.308684 25961 raft_consensus.cc:729] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26018b8a994642d485272abc41b4ce2f, State: Initialized, Role: FOLLOWER
I20260805 23:00:23.308549 25958 consensus_queue.cc:260] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.309020 25961 consensus_queue.cc:260] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.309083 25967 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.309446 25967 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:23.309634 25961 ts_tablet_manager.cc:1428] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 23:00:23.309829 25970 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.310256 25970 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:23.310664 25958 ts_tablet_manager.cc:1428] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260805 23:00:23.672142 25968 consensus_queue.cc:1035] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:23.681063 25990 consensus_queue.cc:1035] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:23.720005 25967 raft_consensus.cc:482] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:23.720263 25967 raft_consensus.cc:504] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.721915 25967 leader_election.cc:288] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:23.723238 25990 raft_consensus.cc:482] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:23.723474 25990 raft_consensus.cc:504] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.724272 25990 leader_election.cc:288] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897)
I20260805 23:00:23.724962 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10dbbf78af3f43b9b31dad5eeb90909a" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f" is_pre_election: true
I20260805 23:00:23.725317 25467 raft_consensus.cc:2454] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 0.
I20260805 23:00:23.725859 25570 leader_election.cc:302] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26018b8a994642d485272abc41b4ce2f, d04f9bf5e5534b869f01b5e73ce2a767; no voters:
I20260805 23:00:23.726260 25990 raft_consensus.cc:2781] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:23.726410 25990 raft_consensus.cc:482] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:23.726534 25990 raft_consensus.cc:3037] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:23.730350 25990 raft_consensus.cc:504] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.731712 25990 leader_election.cc:288] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 election: Requested vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897)
I20260805 23:00:23.732534 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10dbbf78af3f43b9b31dad5eeb90909a" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f"
I20260805 23:00:23.732901 25467 raft_consensus.cc:3037] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:23.735532 25869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10dbbf78af3f43b9b31dad5eeb90909a" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c22c256bc445d9a9ca9e0389cab403" is_pre_election: true
I20260805 23:00:23.735924 25869 raft_consensus.cc:2454] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 0.
I20260805 23:00:23.736413 25467 raft_consensus.cc:2454] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 1.
I20260805 23:00:23.736829 25869 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10dbbf78af3f43b9b31dad5eeb90909a" candidate_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5c22c256bc445d9a9ca9e0389cab403"
I20260805 23:00:23.737077 25869 raft_consensus.cc:3037] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:23.737068 25570 leader_election.cc:302] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26018b8a994642d485272abc41b4ce2f, d04f9bf5e5534b869f01b5e73ce2a767; no voters:
I20260805 23:00:23.737521 25990 raft_consensus.cc:2781] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:23.737726 25990 raft_consensus.cc:686] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 LEADER]: Becoming Leader. State: Replica: d04f9bf5e5534b869f01b5e73ce2a767, State: Running, Role: LEADER
I20260805 23:00:23.737989 25990 consensus_queue.cc:237] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.741107 25869 raft_consensus.cc:2454] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d04f9bf5e5534b869f01b5e73ce2a767 in term 1.
I20260805 23:00:23.743101 25994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.722181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39203 (local address 127.22.45.67:48907)
0805 23:00:23.722688 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:23.722717 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:23.722887 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:23.735895 (+ 13008us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:23.735905 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:23.735937 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:23.736222 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.736236 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.737973 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.737983 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.740288 (+ 2305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.740308 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.742226 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.742232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.742422 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.742459 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 23:00:23.742532 (+ 73us) client_negotiation.cc:240] Negotiation successful
0805 23:00:23.742709 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":260,"threads_started":1}
I20260805 23:00:23.743469 25995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.722215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:42809 (local address 127.22.45.67:53501)
0805 23:00:23.735498 (+ 13283us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:23.735525 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:23.735677 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:23.736308 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:23.736313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:23.736341 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:23.736759 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.736774 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.738219 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.738224 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.740515 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.740534 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.742636 (+ 2102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.742642 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.742837 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.742869 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 23:00:23.742980 (+ 111us) client_negotiation.cc:240] Negotiation successful
0805 23:00:23.743132 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13117,"thread_start_us":12529,"threads_started":1}
I20260805 23:00:23.743542 25973 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: TxnStatusTablet state changed. Reason: New leader d04f9bf5e5534b869f01b5e73ce2a767. Latest consensus state: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.743901 25973 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:00:23.744234 25996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.722276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:48907 (local address 127.22.45.65:39203)
0805 23:00:23.735482 (+ 13206us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.735488 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.735513 (+ 25us) server_negotiation.cc:407] Connection header received
0805 23:00:23.735618 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.735624 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.735706 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.736409 (+ 703us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:23.736569 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.737782 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.740795 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.742032 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.743650 (+ 1618us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.743784 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.743837 (+ 53us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.743979 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13045,"thread_start_us":12871,"threads_started":1}
I20260805 23:00:23.744650 26000 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 23:00:23.744655 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.722621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:53501 (local address 127.22.45.66:42809)
0805 23:00:23.723589 (+ 968us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.723596 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.735818 (+ 12222us) server_negotiation.cc:407] Connection header received
0805 23:00:23.735904 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.735909 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.735984 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.736083 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:23.736949 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.738008 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.740773 (+ 2765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.742240 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.742414 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.742495 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.743790 (+ 1295us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.743950 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":815,"thread_start_us":284,"threads_started":1}
I20260805 23:00:23.744931 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10dbbf78af3f43b9b31dad5eeb90909a" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f" is_pre_election: true
I20260805 23:00:23.745157 26000 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 23:00:23.745429 25467 raft_consensus.cc:2379] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5c22c256bc445d9a9ca9e0389cab403 in current term 1: Already voted for candidate d04f9bf5e5534b869f01b5e73ce2a767 in this term.
I20260805 23:00:23.745852 25667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10dbbf78af3f43b9b31dad5eeb90909a" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" is_pre_election: true
I20260805 23:00:23.745792 25235 catalog_manager.cc:5495] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 reported cstate change: term changed from 0 to 1, leader changed from <none> to d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } health_report { overall_health: UNKNOWN } } }
I20260805 23:00:23.747188 25769 leader_election.cc:302] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5c22c256bc445d9a9ca9e0389cab403; no voters: 26018b8a994642d485272abc41b4ce2f, d04f9bf5e5534b869f01b5e73ce2a767
I20260805 23:00:23.747690 25967 raft_consensus.cc:2726] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260805 23:00:23.775377 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.768907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44344 (local address 127.22.45.66:42809)
0805 23:00:23.769127 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.769133 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.769159 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:00:23.769462 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.769468 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.769605 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.769776 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:23.770107 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.771272 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.772690 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.773184 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.773300 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.774038 (+ 738us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:23.774741 (+ 703us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:23.774862 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.775044 (+ 182us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.775128 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 23:00:23.775657 25983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.768816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:42809 (local address 127.0.0.1:44344)
0805 23:00:23.769071 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:23.769105 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:23.769239 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:23.769781 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:23.769784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:23.769795 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:00:23.769973 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.769980 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.771411 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.771414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.772481 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.772496 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.773388 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.773396 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.773617 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.773751 (+ 134us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:00:23.774867 (+ 1116us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:00:23.774895 (+ 28us) client_negotiation.cc:769] Sending connection context
0805 23:00:23.775024 (+ 129us) client_negotiation.cc:240] Negotiation successful
0805 23:00:23.775223 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260805 23:00:23.784373 25467 raft_consensus.cc:1261] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Refusing update from remote peer d04f9bf5e5534b869f01b5e73ce2a767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:23.784709 25869 raft_consensus.cc:1261] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Refusing update from remote peer d04f9bf5e5534b869f01b5e73ce2a767: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:23.785302 25973 consensus_queue.cc:1035] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:23.785686 25990 consensus_queue.cc:1035] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:23.799424 25967 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: TxnStatusTablet state changed. Reason: New leader d04f9bf5e5534b869f01b5e73ce2a767. Latest consensus state: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.799777 25967 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:23.800793 25970 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: TxnStatusTablet state changed. Reason: New leader d04f9bf5e5534b869f01b5e73ce2a767. Latest consensus state: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.801146 25970 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:23.802627 25989 mvcc.cc:205] Tried to move back new op lower bound from 7315336494211915776 to 7315336494034329600. Current Snapshot: MvccSnapshot[applied={T|T < 7315336494211915776}]
I20260805 23:00:23.803347 25973 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.804086 25973 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:00:23.803690 25990 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.804487 25990 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P d04f9bf5e5534b869f01b5e73ce2a767: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:00:23.812361 25967 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.812682 25967 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P e5c22c256bc445d9a9ca9e0389cab403: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:23.818749 25970 tablet_replica.cc:439] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } } }
I20260805 23:00:23.819096 25970 tablet_replica.cc:442] T 10dbbf78af3f43b9b31dad5eeb90909a P 26018b8a994642d485272abc41b4ce2f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:00:23.833040 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.823843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44354 (local address 127.22.45.66:42809)
0805 23:00:23.824030 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.824037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.827564 (+ 3527us) server_negotiation.cc:407] Connection header received
0805 23:00:23.827774 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.827779 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.827854 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.827939 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:23.828408 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.829224 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.830663 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.831304 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.831478 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.831978 (+ 500us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:23.832280 (+ 302us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:23.832374 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.832571 (+ 197us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.832727 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 23:00:23.851567 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.845423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:50661 (local address 127.22.45.66:42809)
0805 23:00:23.845834 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:23.845841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:23.846320 (+ 479us) server_negotiation.cc:407] Connection header received
0805 23:00:23.846500 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:23.846505 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:23.846584 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:23.846665 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:23.847257 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.848144 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.849622 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.850096 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.850212 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.850763 (+ 551us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:23.850882 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:23.851006 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:23.851122 (+ 116us) server_negotiation.cc:299] Negotiation successful
0805 23:00:23.851201 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":274}
I20260805 23:00:23.851650 26017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:23.845447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:42809 (local address 127.22.45.66:50661)
0805 23:00:23.846173 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:23.846190 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:23.846364 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:23.846690 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:23.846695 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:23.846705 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:00:23.847114 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.847124 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.848298 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.848304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.849463 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:23.849477 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:23.850253 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:23.850260 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:23.850413 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:23.850488 (+ 75us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:00:23.851007 (+ 519us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:00:23.851017 (+ 10us) client_negotiation.cc:769] Sending connection context
0805 23:00:23.851096 (+ 79us) client_negotiation.cc:240] Negotiation successful
0805 23:00:23.851249 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":396,"threads_started":1}
I20260805 23:00:23.934623 25235 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:23.934999 25235 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:23.939916 25235 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Sending DeleteTablet for 3 replicas of tablet edd3f0ef71e84b3ca6fa3717c679daa8
I20260805 23:00:23.941504 25837 tablet_service.cc:1514] Processing DeleteTablet for tablet edd3f0ef71e84b3ca6fa3717c679daa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:23 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:42910
I20260805 23:00:23.941689 25438 tablet_service.cc:1514] Processing DeleteTablet for tablet edd3f0ef71e84b3ca6fa3717c679daa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:23 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:56714
I20260805 23:00:23.943122 25640 tablet_service.cc:1514] Processing DeleteTablet for tablet edd3f0ef71e84b3ca6fa3717c679daa8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:23 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:44340
I20260805 23:00:23.952525 25235 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41464:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:23.953383 25235 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:23.956920 26024 tablet_replica.cc:330] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: stopping tablet replica
I20260805 23:00:23.957474 26024 raft_consensus.cc:2229] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:23.957893 26024 raft_consensus.cc:2258] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:23.962539 25438 tablet_service.cc:1467] Processing CreateTablet for tablet 5c9eb58dfd56441ba51f0225052edebf (DEFAULT_TABLE table=test-table [id=65df2a686dfd451e91f2818857284d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:23.962615 25638 tablet_service.cc:1467] Processing CreateTablet for tablet 5c9eb58dfd56441ba51f0225052edebf (DEFAULT_TABLE table=test-table [id=65df2a686dfd451e91f2818857284d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:23.962618 25836 tablet_service.cc:1467] Processing CreateTablet for tablet 5c9eb58dfd56441ba51f0225052edebf (DEFAULT_TABLE table=test-table [id=65df2a686dfd451e91f2818857284d57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:23.963199 25438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c9eb58dfd56441ba51f0225052edebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:23.963255 25638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c9eb58dfd56441ba51f0225052edebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:23.963267 25836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c9eb58dfd56441ba51f0225052edebf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:23.979609 26029 tablet_bootstrap.cc:492] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: Bootstrap starting.
I20260805 23:00:23.981477 26030 tablet_bootstrap.cc:492] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: Bootstrap starting.
I20260805 23:00:23.981833 26029 tablet_bootstrap.cc:654] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:23.983613 26030 tablet_bootstrap.cc:654] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:23.987293 26024 ts_tablet_manager.cc:1905] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:23.986318 26025 tablet_replica.cc:330] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: stopping tablet replica
I20260805 23:00:23.991338 26025 raft_consensus.cc:2229] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:23.992594 26021 tablet_replica.cc:330] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: stopping tablet replica
I20260805 23:00:23.992734 26026 tablet_bootstrap.cc:492] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: Bootstrap starting.
I20260805 23:00:23.993139 26021 raft_consensus.cc:2229] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:23.993582 26021 raft_consensus.cc:2258] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:23.994482 26026 tablet_bootstrap.cc:654] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:23.994710 26025 raft_consensus.cc:2258] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:23.995348 26030 tablet_bootstrap.cc:492] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: No bootstrap required, opened a new log
I20260805 23:00:23.995585 26030 ts_tablet_manager.cc:1397] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.003s
I20260805 23:00:23.996542 26029 tablet_bootstrap.cc:492] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: No bootstrap required, opened a new log
I20260805 23:00:23.996711 26029 ts_tablet_manager.cc:1397] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.004s
I20260805 23:00:23.997447 26021 ts_tablet_manager.cc:1905] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:23.997565 26029 raft_consensus.cc:348] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.997817 26029 raft_consensus.cc:374] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:23.997922 26029 raft_consensus.cc:729] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Initialized, Role: FOLLOWER
I20260805 23:00:23.998173 26029 consensus_queue.cc:260] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:23.998907 26029 ts_tablet_manager.cc:1428] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 23:00:24.000662 26026 tablet_bootstrap.cc:492] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: No bootstrap required, opened a new log
I20260805 23:00:24.000813 26026 ts_tablet_manager.cc:1397] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s
I20260805 23:00:24.001336 26024 ts_tablet_manager.cc:1918] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:24.001541 26024 log.cc:1196] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/edd3f0ef71e84b3ca6fa3717c679daa8
I20260805 23:00:24.001639 26026 raft_consensus.cc:348] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:24.001889 26026 raft_consensus.cc:374] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:24.001981 26026 raft_consensus.cc:729] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26018b8a994642d485272abc41b4ce2f, State: Initialized, Role: FOLLOWER
I20260805 23:00:24.002173 26024 ts_tablet_manager.cc:1939] T edd3f0ef71e84b3ca6fa3717c679daa8 P 26018b8a994642d485272abc41b4ce2f: Deleting consensus metadata
I20260805 23:00:24.002341 26026 consensus_queue.cc:260] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:24.003611 26026 ts_tablet_manager.cc:1428] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:24.004451 25210 catalog_manager.cc:4841] TS 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203): tablet edd3f0ef71e84b3ca6fa3717c679daa8 (table test-table [id=b915391b36574ae095af2cb2311131d1]) successfully deleted
I20260805 23:00:24.004356 26030 raft_consensus.cc:348] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:24.004652 26030 raft_consensus.cc:374] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:24.005146 26030 raft_consensus.cc:729] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04f9bf5e5534b869f01b5e73ce2a767, State: Initialized, Role: FOLLOWER
I20260805 23:00:24.005434 26030 consensus_queue.cc:260] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:24.006104 26021 ts_tablet_manager.cc:1918] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:24.006292 26021 log.cc:1196] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/edd3f0ef71e84b3ca6fa3717c679daa8
I20260805 23:00:24.006377 26030 ts_tablet_manager.cc:1428] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s
I20260805 23:00:24.006862 26021 ts_tablet_manager.cc:1939] T edd3f0ef71e84b3ca6fa3717c679daa8 P e5c22c256bc445d9a9ca9e0389cab403: Deleting consensus metadata
I20260805 23:00:24.009279 26025 ts_tablet_manager.cc:1905] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:24.009526 25218 catalog_manager.cc:4841] TS e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897): tablet edd3f0ef71e84b3ca6fa3717c679daa8 (table test-table [id=b915391b36574ae095af2cb2311131d1]) successfully deleted
I20260805 23:00:24.016093 26025 ts_tablet_manager.cc:1918] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:24.016283 26025 log.cc:1196] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/edd3f0ef71e84b3ca6fa3717c679daa8
I20260805 23:00:24.016805 26025 ts_tablet_manager.cc:1939] T edd3f0ef71e84b3ca6fa3717c679daa8 P d04f9bf5e5534b869f01b5e73ce2a767: Deleting consensus metadata
I20260805 23:00:24.018818 25212 catalog_manager.cc:4841] TS d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809): tablet edd3f0ef71e84b3ca6fa3717c679daa8 (table test-table [id=b915391b36574ae095af2cb2311131d1]) successfully deleted
I20260805 23:00:24.054330 25967 raft_consensus.cc:482] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:24.054559 25967 raft_consensus.cc:504] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:24.055306 25967 leader_election.cc:288] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:24.055995 25667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c9eb58dfd56441ba51f0225052edebf" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" is_pre_election: true
I20260805 23:00:24.055992 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c9eb58dfd56441ba51f0225052edebf" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f" is_pre_election: true
I20260805 23:00:24.056305 25467 raft_consensus.cc:2454] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 0.
I20260805 23:00:24.056332 25667 raft_consensus.cc:2454] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 0.
I20260805 23:00:24.056859 25770 leader_election.cc:302] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d04f9bf5e5534b869f01b5e73ce2a767, e5c22c256bc445d9a9ca9e0389cab403; no voters:
I20260805 23:00:24.057192 25967 raft_consensus.cc:2781] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:24.057314 25967 raft_consensus.cc:482] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:24.057420 25967 raft_consensus.cc:3037] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:24.060191 25967 raft_consensus.cc:504] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:24.060887 25967 leader_election.cc:288] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 election: Requested vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:24.061439 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c9eb58dfd56441ba51f0225052edebf" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f"
I20260805 23:00:24.061553 25667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c9eb58dfd56441ba51f0225052edebf" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04f9bf5e5534b869f01b5e73ce2a767"
I20260805 23:00:24.061693 25467 raft_consensus.cc:3037] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:24.061903 25667 raft_consensus.cc:3037] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:24.064033 25467 raft_consensus.cc:2454] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 1.
I20260805 23:00:24.064518 25769 leader_election.cc:302] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26018b8a994642d485272abc41b4ce2f, e5c22c256bc445d9a9ca9e0389cab403; no voters:
I20260805 23:00:24.064821 25967 raft_consensus.cc:2781] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:24.065281 25967 raft_consensus.cc:686] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 1 LEADER]: Becoming Leader. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Running, Role: LEADER
I20260805 23:00:24.065325 25667 raft_consensus.cc:2454] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 1.
I20260805 23:00:24.065943 25967 consensus_queue.cc:237] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:24.069653 25235 catalog_manager.cc:5495] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67). New cstate: current_term: 1 leader_uuid: "e5c22c256bc445d9a9ca9e0389cab403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } health_report { overall_health: HEALTHY } } }
I20260805 23:00:24.098563 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:24.092739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42918 (local address 127.22.45.67:35897)
0805 23:00:24.093357 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:24.093362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:24.093379 (+ 17us) server_negotiation.cc:407] Connection header received
0805 23:00:24.093458 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:24.093462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:24.093541 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:24.093694 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:24.094119 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.094903 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.096235 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.096653 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.096766 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:24.097236 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:24.097861 (+ 625us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:24.098000 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:24.098128 (+ 128us) server_negotiation.cc:299] Negotiation successful
0805 23:00:24.098229 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":340,"threads_started":1}
I20260805 23:00:24.120276 25997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:24.113443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:44985 (local address 127.22.45.66:42809)
0805 23:00:24.113685 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:24.113692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:24.114345 (+ 653us) server_negotiation.cc:407] Connection header received
0805 23:00:24.114556 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:24.114560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:24.114648 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:24.114745 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:24.115350 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.116135 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.118145 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.118777 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.118889 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:24.119485 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:24.119624 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:24.119698 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:24.119929 (+ 231us) server_negotiation.cc:299] Negotiation successful
0805 23:00:24.120032 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260805 23:00:24.120420 26043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:24.113417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:42809 (local address 127.22.45.67:44985)
0805 23:00:24.114222 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:24.114245 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:24.114428 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:24.114780 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:24.114785 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:24.114798 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:00:24.115194 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:24.115210 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.116288 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.116293 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:24.117987 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:24.118006 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.119009 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.119016 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:24.119222 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:24.119311 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:00:24.119741 (+ 430us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:00:24.119754 (+ 13us) client_negotiation.cc:769] Sending connection context
0805 23:00:24.119843 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 23:00:24.120005 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":386,"threads_started":1}
I20260805 23:00:24.132243 25467 raft_consensus.cc:1261] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Refusing update from remote peer e5c22c256bc445d9a9ca9e0389cab403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:24.132336 25667 raft_consensus.cc:1261] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Refusing update from remote peer e5c22c256bc445d9a9ca9e0389cab403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:24.133237 26038 consensus_queue.cc:1035] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:24.133788 25967 consensus_queue.cc:1035] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:24.143278 25993 mvcc.cc:205] Tried to move back new op lower bound from 7315336495637274624 to 7315336495377768448. Current Snapshot: MvccSnapshot[applied={T|T < 7315336495637274624}]
I20260805 23:00:24.176797 26017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:24.169915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:35897 (local address 127.22.45.66:52185)
0805 23:00:24.170170 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:24.170193 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:24.170341 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:24.170998 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:24.171004 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:24.171018 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:00:24.171259 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:24.171273 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.172722 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.172728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:24.174161 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:24.174182 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.175272 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.175278 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:24.175490 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:24.175554 (+ 64us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:00:24.176064 (+ 510us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:00:24.176077 (+ 13us) client_negotiation.cc:769] Sending connection context
0805 23:00:24.176199 (+ 122us) client_negotiation.cc:240] Negotiation successful
0805 23:00:24.176389 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260805 23:00:24.177515 26040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:24.169814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:52185 (local address 127.22.45.67:35897)
0805 23:00:24.170140 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:24.170147 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:24.170475 (+ 328us) server_negotiation.cc:407] Connection header received
0805 23:00:24.170557 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:24.170563 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:24.170652 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:24.170741 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:24.171445 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.172556 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.174373 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:24.175062 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:24.175198 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:24.175778 (+ 580us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:24.175933 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:24.176045 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:24.177175 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0805 23:00:24.177272 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
W20260805 23:00:24.178779 25993 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 23:00:25.823032 25237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:25.823310 25237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41464:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:25.828379 25237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Sending DeleteTablet for 3 replicas of tablet 5c9eb58dfd56441ba51f0225052edebf
I20260805 23:00:25.829521 25836 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c9eb58dfd56441ba51f0225052edebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:25 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:42910
I20260805 23:00:25.829710 25638 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c9eb58dfd56441ba51f0225052edebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:25 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:44340
I20260805 23:00:25.829849 25438 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c9eb58dfd56441ba51f0225052edebf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:25 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:56714
I20260805 23:00:25.847047 26080 tablet_replica.cc:330] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: stopping tablet replica
I20260805 23:00:25.847311 26080 raft_consensus.cc:2229] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:25.847615 26080 raft_consensus.cc:2258] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:25.848863 26080 ts_tablet_manager.cc:1905] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:25.851742 26082 tablet_replica.cc:330] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: stopping tablet replica
I20260805 23:00:25.852026 26082 raft_consensus.cc:2229] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:25.852312 26082 raft_consensus.cc:2258] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:25.853279 26082 ts_tablet_manager.cc:1905] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:25.855351 26079 tablet_replica.cc:330] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: stopping tablet replica
I20260805 23:00:25.855633 26080 ts_tablet_manager.cc:1918] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 23:00:25.855887 26080 log.cc:1196] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/5c9eb58dfd56441ba51f0225052edebf
I20260805 23:00:25.856606 26080 ts_tablet_manager.cc:1939] T 5c9eb58dfd56441ba51f0225052edebf P d04f9bf5e5534b869f01b5e73ce2a767: Deleting consensus metadata
I20260805 23:00:25.856865 26079 raft_consensus.cc:2229] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:25.858158 25212 catalog_manager.cc:4841] TS d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809): tablet 5c9eb58dfd56441ba51f0225052edebf (table test-table [id=65df2a686dfd451e91f2818857284d57]) successfully deleted
I20260805 23:00:25.858532 26079 raft_consensus.cc:2258] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:25.859825 26079 ts_tablet_manager.cc:1905] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:25.859836 26082 ts_tablet_manager.cc:1918] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 23:00:25.859979 26082 log.cc:1196] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/5c9eb58dfd56441ba51f0225052edebf
I20260805 23:00:25.860495 26082 ts_tablet_manager.cc:1939] T 5c9eb58dfd56441ba51f0225052edebf P 26018b8a994642d485272abc41b4ce2f: Deleting consensus metadata
I20260805 23:00:25.861783 25210 catalog_manager.cc:4841] TS 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203): tablet 5c9eb58dfd56441ba51f0225052edebf (table test-table [id=65df2a686dfd451e91f2818857284d57]) successfully deleted
I20260805 23:00:25.865656 26079 ts_tablet_manager.cc:1918] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 23:00:25.865810 26079 log.cc:1196] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/5c9eb58dfd56441ba51f0225052edebf
I20260805 23:00:25.866207 26079 ts_tablet_manager.cc:1939] T 5c9eb58dfd56441ba51f0225052edebf P e5c22c256bc445d9a9ca9e0389cab403: Deleting consensus metadata
I20260805 23:00:25.867373 25218 catalog_manager.cc:4841] TS e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897): tablet 5c9eb58dfd56441ba51f0225052edebf (table test-table [id=65df2a686dfd451e91f2818857284d57]) successfully deleted
Aug 05 23:00:25 dist-test-slave-1vmg krb5kdc[25167](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970825, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 23:00:25 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970825, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:25.919237 26091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:25.901810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48836 (local address 127.22.45.126:38041)
0805 23:00:25.902712 (+ 902us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:25.902717 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:25.902741 (+ 24us) server_negotiation.cc:407] Connection header received
0805 23:00:25.902813 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:25.902817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:25.902883 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:25.903030 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:25.904936 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:25.905881 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:25.907307 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:25.907785 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:25.907902 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:25.912576 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:25.912583 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:25.912586 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:25.912632 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:25.916036 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:25.917085 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:25.917091 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:25.917094 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:25.917298 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:25.917725 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:25.917729 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:25.917731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:25.918064 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:25.918319 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:25.918634 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 23:00:25.918859 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":777,"thread_start_us":600,"threads_started":1}
I20260805 23:00:25.923142 25237 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:25.923797 25237 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:25.931063 25638 tablet_service.cc:1467] Processing CreateTablet for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 (DEFAULT_TABLE table=test-table [id=fb0fc030dc82419db4c63dc9817fad1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:25.931241 25438 tablet_service.cc:1467] Processing CreateTablet for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 (DEFAULT_TABLE table=test-table [id=fb0fc030dc82419db4c63dc9817fad1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:25.931613 25638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:25.931679 25438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:25.938898 26095 tablet_bootstrap.cc:492] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: Bootstrap starting.
I20260805 23:00:25.939046 25836 tablet_service.cc:1467] Processing CreateTablet for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 (DEFAULT_TABLE table=test-table [id=fb0fc030dc82419db4c63dc9817fad1c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:25.939603 25836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:25.942848 26095 tablet_bootstrap.cc:654] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:25.946094 26092 tablet_bootstrap.cc:492] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: Bootstrap starting.
I20260805 23:00:25.947270 26097 tablet_bootstrap.cc:492] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: Bootstrap starting.
I20260805 23:00:25.948908 26092 tablet_bootstrap.cc:654] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:25.949084 26097 tablet_bootstrap.cc:654] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:25.950186 26095 tablet_bootstrap.cc:492] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: No bootstrap required, opened a new log
I20260805 23:00:25.950353 26095 ts_tablet_manager.cc:1397] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.002s
I20260805 23:00:25.951210 26097 tablet_bootstrap.cc:492] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: No bootstrap required, opened a new log
I20260805 23:00:25.951233 26095 raft_consensus.cc:348] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:25.951516 26095 raft_consensus.cc:374] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:25.951453 26097 ts_tablet_manager.cc:1397] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.004s
I20260805 23:00:25.951609 26095 raft_consensus.cc:729] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26018b8a994642d485272abc41b4ce2f, State: Initialized, Role: FOLLOWER
I20260805 23:00:25.951858 26095 consensus_queue.cc:260] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:25.952661 26097 raft_consensus.cc:348] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:25.952963 26097 raft_consensus.cc:374] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:25.953118 26097 raft_consensus.cc:729] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Initialized, Role: FOLLOWER
I20260805 23:00:25.953501 26097 consensus_queue.cc:260] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:25.957345 26097 ts_tablet_manager.cc:1428] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s
I20260805 23:00:25.962783 26095 ts_tablet_manager.cc:1428] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: Time spent starting tablet: real 0.012s user 0.008s sys 0.005s
I20260805 23:00:25.963603 26092 tablet_bootstrap.cc:492] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: No bootstrap required, opened a new log
I20260805 23:00:25.963804 26092 ts_tablet_manager.cc:1397] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.008s
I20260805 23:00:25.964752 26092 raft_consensus.cc:348] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:25.965041 26092 raft_consensus.cc:374] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:25.965150 26092 raft_consensus.cc:729] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04f9bf5e5534b869f01b5e73ce2a767, State: Initialized, Role: FOLLOWER
I20260805 23:00:25.965411 26092 consensus_queue.cc:260] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:25.966027 26092 ts_tablet_manager.cc:1428] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260805 23:00:26.370628 26038 raft_consensus.cc:482] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:26.370877 26038 raft_consensus.cc:504] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.371649 26038 leader_election.cc:288] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:26.372305 25667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89dd18511f6a4d81bacbb5f6c4ddffa1" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" is_pre_election: true
I20260805 23:00:26.372305 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89dd18511f6a4d81bacbb5f6c4ddffa1" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f" is_pre_election: true
I20260805 23:00:26.372591 25667 raft_consensus.cc:2454] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 0.
I20260805 23:00:26.372613 25467 raft_consensus.cc:2454] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 0.
I20260805 23:00:26.373109 25770 leader_election.cc:302] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 26018b8a994642d485272abc41b4ce2f, d04f9bf5e5534b869f01b5e73ce2a767, e5c22c256bc445d9a9ca9e0389cab403; no voters:
I20260805 23:00:26.373438 26038 raft_consensus.cc:2781] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:26.373558 26038 raft_consensus.cc:482] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:26.373672 26038 raft_consensus.cc:3037] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:26.375846 26038 raft_consensus.cc:504] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.376631 26038 leader_election.cc:288] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 election: Requested vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:26.377141 25667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89dd18511f6a4d81bacbb5f6c4ddffa1" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04f9bf5e5534b869f01b5e73ce2a767"
I20260805 23:00:26.377158 25467 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89dd18511f6a4d81bacbb5f6c4ddffa1" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f"
I20260805 23:00:26.377436 25667 raft_consensus.cc:3037] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:26.377446 25467 raft_consensus.cc:3037] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:26.379941 25467 raft_consensus.cc:2454] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 1.
I20260805 23:00:26.379961 25667 raft_consensus.cc:2454] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 1.
I20260805 23:00:26.380528 25769 leader_election.cc:302] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 26018b8a994642d485272abc41b4ce2f, d04f9bf5e5534b869f01b5e73ce2a767, e5c22c256bc445d9a9ca9e0389cab403; no voters:
I20260805 23:00:26.380877 26038 raft_consensus.cc:2781] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:26.381343 26038 raft_consensus.cc:686] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 LEADER]: Becoming Leader. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Running, Role: LEADER
I20260805 23:00:26.381618 26038 consensus_queue.cc:237] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.384692 25235 catalog_manager.cc:5495] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67). New cstate: current_term: 1 leader_uuid: "e5c22c256bc445d9a9ca9e0389cab403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } health_report { overall_health: HEALTHY } } }
I20260805 23:00:26.416774 26116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:26.411841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41148 (local address 127.22.45.67:35897)
0805 23:00:26.412350 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:26.412355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:26.412376 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:00:26.412432 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:26.412436 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:26.412498 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:26.412579 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:26.412894 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:26.413630 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:26.415025 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:26.415457 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:26.415551 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:26.416054 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:26.416188 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:26.416272 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:26.416373 (+ 101us) server_negotiation.cc:299] Negotiation successful
0805 23:00:26.416443 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":283,"threads_started":1}
I20260805 23:00:26.427166 25667 raft_consensus.cc:1261] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Refusing update from remote peer e5c22c256bc445d9a9ca9e0389cab403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:26.427289 25467 raft_consensus.cc:1261] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Refusing update from remote peer e5c22c256bc445d9a9ca9e0389cab403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:26.427775 26102 consensus_queue.cc:1035] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:26.428189 26038 consensus_queue.cc:1035] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:26.486388 25237 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:26.486837 25237 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:26.491511 25237 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Sending DeleteTablet for 3 replicas of tablet 89dd18511f6a4d81bacbb5f6c4ddffa1
I20260805 23:00:26.492642 25836 tablet_service.cc:1514] Processing DeleteTablet for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:26 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:42910
I20260805 23:00:26.492654 25438 tablet_service.cc:1514] Processing DeleteTablet for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:26 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:56714
I20260805 23:00:26.492671 25638 tablet_service.cc:1514] Processing DeleteTablet for tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:26 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:44340
I20260805 23:00:26.494830 26131 tablet_replica.cc:330] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: stopping tablet replica
I20260805 23:00:26.494669 25235 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260805 23:00:26.495122 26131 raft_consensus.cc:2229] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:26.495435 26131 raft_consensus.cc:2258] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260805 23:00:26.495630 25235 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:26.496860 26131 ts_tablet_manager.cc:1905] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:26.498432 26128 tablet_replica.cc:330] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: stopping tablet replica
I20260805 23:00:26.498659 26128 raft_consensus.cc:2229] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:26.499332 26133 tablet_replica.cc:330] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: stopping tablet replica
I20260805 23:00:26.499480 26128 raft_consensus.cc:2258] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:26.499552 26133 raft_consensus.cc:2229] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:26.499990 26133 raft_consensus.cc:2258] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:26.500965 26133 ts_tablet_manager.cc:1905] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:26.503268 26128 ts_tablet_manager.cc:1905] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:26.505172 26131 ts_tablet_manager.cc:1918] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:26.505368 26131 log.cc:1196] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/89dd18511f6a4d81bacbb5f6c4ddffa1
I20260805 23:00:26.505383 25438 tablet_service.cc:1467] Processing CreateTablet for tablet 5269787ce5a646e18b9733effc27418a (DEFAULT_TABLE table=test-table [id=fa7f3f33975347bfa6e6893a112ebe8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:26.505836 26131 ts_tablet_manager.cc:1939] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P 26018b8a994642d485272abc41b4ce2f: Deleting consensus metadata
I20260805 23:00:26.505908 25438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5269787ce5a646e18b9733effc27418a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:26.506337 25638 tablet_service.cc:1467] Processing CreateTablet for tablet 5269787ce5a646e18b9733effc27418a (DEFAULT_TABLE table=test-table [id=fa7f3f33975347bfa6e6893a112ebe8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:26.506788 25638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5269787ce5a646e18b9733effc27418a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:26.507653 25836 tablet_service.cc:1467] Processing CreateTablet for tablet 5269787ce5a646e18b9733effc27418a (DEFAULT_TABLE table=test-table [id=fa7f3f33975347bfa6e6893a112ebe8d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:26.508083 25836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5269787ce5a646e18b9733effc27418a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:26.508112 26133 ts_tablet_manager.cc:1918] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:26.508234 26133 log.cc:1196] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/89dd18511f6a4d81bacbb5f6c4ddffa1
I20260805 23:00:26.508719 26133 ts_tablet_manager.cc:1939] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P e5c22c256bc445d9a9ca9e0389cab403: Deleting consensus metadata
I20260805 23:00:26.510063 25218 catalog_manager.cc:4841] TS e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897): tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 (table test-table [id=fb0fc030dc82419db4c63dc9817fad1c]) successfully deleted
I20260805 23:00:26.510705 25210 catalog_manager.cc:4841] TS 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203): tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 (table test-table [id=fb0fc030dc82419db4c63dc9817fad1c]) successfully deleted
I20260805 23:00:26.519131 26128 ts_tablet_manager.cc:1918] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:00:26.519507 26128 log.cc:1196] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/89dd18511f6a4d81bacbb5f6c4ddffa1
I20260805 23:00:26.520190 26128 ts_tablet_manager.cc:1939] T 89dd18511f6a4d81bacbb5f6c4ddffa1 P d04f9bf5e5534b869f01b5e73ce2a767: Deleting consensus metadata
I20260805 23:00:26.520993 26134 tablet_bootstrap.cc:492] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: Bootstrap starting.
I20260805 23:00:26.521487 26137 tablet_bootstrap.cc:492] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: Bootstrap starting.
I20260805 23:00:26.521745 25212 catalog_manager.cc:4841] TS d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809): tablet 89dd18511f6a4d81bacbb5f6c4ddffa1 (table test-table [id=fb0fc030dc82419db4c63dc9817fad1c]) successfully deleted
I20260805 23:00:26.523571 26137 tablet_bootstrap.cc:654] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:26.523788 26139 tablet_bootstrap.cc:492] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: Bootstrap starting.
I20260805 23:00:26.523857 26134 tablet_bootstrap.cc:654] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:26.525559 26139 tablet_bootstrap.cc:654] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:26.525908 26137 tablet_bootstrap.cc:492] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: No bootstrap required, opened a new log
I20260805 23:00:26.526041 26134 tablet_bootstrap.cc:492] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: No bootstrap required, opened a new log
I20260805 23:00:26.526070 26137 ts_tablet_manager.cc:1397] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260805 23:00:26.526188 26134 ts_tablet_manager.cc:1397] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260805 23:00:26.526997 26137 raft_consensus.cc:348] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.527020 26134 raft_consensus.cc:348] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.527297 26137 raft_consensus.cc:374] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:26.527300 26134 raft_consensus.cc:374] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:26.527392 26137 raft_consensus.cc:729] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Initialized, Role: FOLLOWER
I20260805 23:00:26.527405 26134 raft_consensus.cc:729] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d04f9bf5e5534b869f01b5e73ce2a767, State: Initialized, Role: FOLLOWER
I20260805 23:00:26.527657 26137 consensus_queue.cc:260] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.527680 26134 consensus_queue.cc:260] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.528258 26134 ts_tablet_manager.cc:1428] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 23:00:26.528288 26137 ts_tablet_manager.cc:1428] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260805 23:00:26.529413 26139 tablet_bootstrap.cc:492] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: No bootstrap required, opened a new log
I20260805 23:00:26.529660 26139 ts_tablet_manager.cc:1397] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260805 23:00:26.530681 26139 raft_consensus.cc:348] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.531050 26139 raft_consensus.cc:374] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:26.531170 26139 raft_consensus.cc:729] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26018b8a994642d485272abc41b4ce2f, State: Initialized, Role: FOLLOWER
I20260805 23:00:26.531450 26139 consensus_queue.cc:260] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.532159 26139 ts_tablet_manager.cc:1428] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 23:00:26.701719 26038 raft_consensus.cc:482] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:26.701980 26038 raft_consensus.cc:504] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.702592 26038 leader_election.cc:288] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:26.703431 25667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269787ce5a646e18b9733effc27418a" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" is_pre_election: true
I20260805 23:00:26.703444 25466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269787ce5a646e18b9733effc27418a" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f" is_pre_election: true
I20260805 23:00:26.703743 25667 raft_consensus.cc:2454] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 0.
I20260805 23:00:26.703838 25466 raft_consensus.cc:2454] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 0.
I20260805 23:00:26.704268 25770 leader_election.cc:302] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d04f9bf5e5534b869f01b5e73ce2a767, e5c22c256bc445d9a9ca9e0389cab403; no voters:
I20260805 23:00:26.704576 26038 raft_consensus.cc:2781] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:26.704663 26038 raft_consensus.cc:482] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:26.704763 26038 raft_consensus.cc:3037] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:26.707403 26038 raft_consensus.cc:504] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.708268 26038 leader_election.cc:288] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 election: Requested vote from peers 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203), d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809)
I20260805 23:00:26.708963 25466 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269787ce5a646e18b9733effc27418a" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26018b8a994642d485272abc41b4ce2f"
I20260805 23:00:26.708956 25667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5269787ce5a646e18b9733effc27418a" candidate_uuid: "e5c22c256bc445d9a9ca9e0389cab403" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d04f9bf5e5534b869f01b5e73ce2a767"
I20260805 23:00:26.709251 25466 raft_consensus.cc:3037] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:26.709267 25667 raft_consensus.cc:3037] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:26.711958 25667 raft_consensus.cc:2454] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 1.
I20260805 23:00:26.712100 25466 raft_consensus.cc:2454] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5c22c256bc445d9a9ca9e0389cab403 in term 1.
I20260805 23:00:26.712599 25770 leader_election.cc:302] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d04f9bf5e5534b869f01b5e73ce2a767, e5c22c256bc445d9a9ca9e0389cab403; no voters:
I20260805 23:00:26.712951 26038 raft_consensus.cc:2781] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:26.713171 26038 raft_consensus.cc:686] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 LEADER]: Becoming Leader. State: Replica: e5c22c256bc445d9a9ca9e0389cab403, State: Running, Role: LEADER
I20260805 23:00:26.713462 26038 consensus_queue.cc:237] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } }
I20260805 23:00:26.716678 25235 catalog_manager.cc:5495] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67). New cstate: current_term: 1 leader_uuid: "e5c22c256bc445d9a9ca9e0389cab403" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5c22c256bc445d9a9ca9e0389cab403" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 35897 } health_report { overall_health: HEALTHY } } }
I20260805 23:00:26.780122 25667 raft_consensus.cc:1261] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Refusing update from remote peer e5c22c256bc445d9a9ca9e0389cab403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:26.780315 25466 raft_consensus.cc:1261] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Refusing update from remote peer e5c22c256bc445d9a9ca9e0389cab403: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:26.780833 26038 consensus_queue.cc:1035] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d04f9bf5e5534b869f01b5e73ce2a767" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:26.781250 26124 consensus_queue.cc:1035] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26018b8a994642d485272abc41b4ce2f" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 23:00:26.803052 26106 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260805 23:00:28.397977 25236 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:28.398298 25236 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:48836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:28.402787 25236 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 01d09ad5f8c441d8a8b4b961e8f46b73: Sending DeleteTablet for 3 replicas of tablet 5269787ce5a646e18b9733effc27418a
I20260805 23:00:28.403838 25638 tablet_service.cc:1514] Processing DeleteTablet for tablet 5269787ce5a646e18b9733effc27418a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:28 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:44340
I20260805 23:00:28.403867 25836 tablet_service.cc:1514] Processing DeleteTablet for tablet 5269787ce5a646e18b9733effc27418a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:28 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:42910
I20260805 23:00:28.403946 25438 tablet_service.cc:1514] Processing DeleteTablet for tablet 5269787ce5a646e18b9733effc27418a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:28 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:56714
I20260805 23:00:28.405438 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 25342
I20260805 23:00:28.419823 26191 tablet_replica.cc:330] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: stopping tablet replica
I20260805 23:00:28.420593 26192 tablet_replica.cc:330] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: stopping tablet replica
I20260805 23:00:28.420783 26191 raft_consensus.cc:2229] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:28.420923 26192 raft_consensus.cc:2229] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:28.421293 26192 raft_consensus.cc:2258] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:28.421327 26191 raft_consensus.cc:2258] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:28.422469 26192 ts_tablet_manager.cc:1905] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:28.422462 26191 ts_tablet_manager.cc:1905] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:28.429692 26191 ts_tablet_manager.cc:1918] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 23:00:28.429692 26192 ts_tablet_manager.cc:1918] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 23:00:28.429975 26191 log.cc:1196] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/5269787ce5a646e18b9733effc27418a
I20260805 23:00:28.429996 26192 log.cc:1196] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/5269787ce5a646e18b9733effc27418a
I20260805 23:00:28.430543 26192 ts_tablet_manager.cc:1939] T 5269787ce5a646e18b9733effc27418a P 26018b8a994642d485272abc41b4ce2f: Deleting consensus metadata
I20260805 23:00:28.430563 26191 ts_tablet_manager.cc:1939] T 5269787ce5a646e18b9733effc27418a P e5c22c256bc445d9a9ca9e0389cab403: Deleting consensus metadata
I20260805 23:00:28.432058 25218 catalog_manager.cc:4841] TS e5c22c256bc445d9a9ca9e0389cab403 (127.22.45.67:35897): tablet 5269787ce5a646e18b9733effc27418a (table test-table [id=fa7f3f33975347bfa6e6893a112ebe8d]) successfully deleted
I20260805 23:00:28.432060 25210 catalog_manager.cc:4841] TS 26018b8a994642d485272abc41b4ce2f (127.22.45.65:39203): tablet 5269787ce5a646e18b9733effc27418a (table test-table [id=fa7f3f33975347bfa6e6893a112ebe8d]) successfully deleted
I20260805 23:00:28.432410 26189 tablet_replica.cc:330] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: stopping tablet replica
I20260805 23:00:28.432623 26189 raft_consensus.cc:2229] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:28.432889 26189 raft_consensus.cc:2258] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:28.433799 26189 ts_tablet_manager.cc:1905] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:28.438724 26189 ts_tablet_manager.cc:1918] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260805 23:00:28.438887 26189 log.cc:1196] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/5269787ce5a646e18b9733effc27418a
I20260805 23:00:28.439306 26189 ts_tablet_manager.cc:1939] T 5269787ce5a646e18b9733effc27418a P d04f9bf5e5534b869f01b5e73ce2a767: Deleting consensus metadata
I20260805 23:00:28.440342 25212 catalog_manager.cc:4841] TS d04f9bf5e5534b869f01b5e73ce2a767 (127.22.45.66:42809): tablet 5269787ce5a646e18b9733effc27418a (table test-table [id=fa7f3f33975347bfa6e6893a112ebe8d]) successfully deleted
Aug 05 23:00:28 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970825, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:28.453115 26194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:28.407976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46082 (local address 127.22.45.65:39203)
0805 23:00:28.433305 (+ 25329us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:28.433312 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:28.433338 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:00:28.433397 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:28.433402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:28.433486 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:28.433591 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:28.435032 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:28.435818 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:28.437105 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:28.437528 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:28.437654 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:28.446546 (+ 8892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:28.446573 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:28.446597 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:28.446682 (+ 85us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:28.449936 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:28.450756 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:28.450764 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:28.450766 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:28.450950 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:28.451357 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:28.451360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:28.451362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:28.451782 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:28.452022 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:28.452480 (+ 458us) server_negotiation.cc:299] Negotiation successful
0805 23:00:28.452745 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25170,"thread_start_us":24185,"threads_started":1}
W20260805 23:00:28.453940 25530 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46082
W20260805 23:00:28.454718 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 25342: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:28.455044 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 25342
I20260805 23:00:28.481367 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 25546
Aug 05 23:00:28 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970825, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:28.497694 26196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:28.482211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45594 (local address 127.22.45.66:42809)
0805 23:00:28.482761 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:28.482766 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:28.482781 (+ 15us) server_negotiation.cc:407] Connection header received
0805 23:00:28.482835 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:28.482839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:28.482904 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:28.483044 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:28.484569 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:28.485327 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:28.486601 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:28.487203 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:28.487324 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:28.491919 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:28.491937 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:28.491956 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:28.491996 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:28.495009 (+ 3013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:28.495753 (+ 744us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:28.495760 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:28.495762 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:28.495904 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:28.496224 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:28.496227 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:28.496229 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:28.496606 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:28.496852 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:28.497129 (+ 277us) server_negotiation.cc:299] Negotiation successful
0805 23:00:28.497316 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":286,"threads_started":1}
W20260805 23:00:28.498409 25731 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45594
W20260805 23:00:28.499240 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 25546: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:28.499413 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 25546
I20260805 23:00:28.533267 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 25749
Aug 05 23:00:28 dist-test-slave-1vmg krb5kdc[25167](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970825, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:28.552603 26197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:28.534066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41164 (local address 127.22.45.67:35897)
0805 23:00:28.534662 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:28.534671 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:28.534695 (+ 24us) server_negotiation.cc:407] Connection header received
0805 23:00:28.534783 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:28.534790 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:28.534881 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:28.535041 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:28.536430 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:28.537675 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:28.539077 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:28.539772 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:28.539918 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:28.545344 (+ 5426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:28.545363 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:28.545381 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:28.545449 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:28.548930 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:28.550100 (+ 1170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:28.550108 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:28.550111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:28.550290 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:28.550736 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:28.550740 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:28.550742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:28.551378 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:28.551688 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:28.552010 (+ 322us) server_negotiation.cc:299] Negotiation successful
0805 23:00:28.552242 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":280,"threads_started":1}
W20260805 23:00:28.553435 25924 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41164
W20260805 23:00:28.554265 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 25749: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:28.554469 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 25749
I20260805 23:00:28.579109 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 25186
I20260805 23:00:28.580483 25296 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:28.700722 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 25186
2026-08-05T23:00:28Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9690 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:28 dist-test-slave-1vmg krb5kdc[26202](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:28 dist-test-slave-1vmg krb5kdc[26202](info): set up 2 sockets
Aug 05 23:00:28 dist-test-slave-1vmg krb5kdc[26202](info): commencing operation
krb5kdc: starting...
W20260805 23:00:29.907990 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.002s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:30 dist-test-slave-1vmg krb5kdc[26202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:30.156260 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:44759
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:44759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:30.506769 26221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:30.507226 26221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:30.507373 26221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:30.514878 26221 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:30.515072 26221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:30.515133 26221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:30.515192 26221 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:30.515240 26221 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:30.525934 26221 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:44759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:44759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:30.527493 26221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:30.528887 26221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:30.541882 26233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:30.542271 26231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:30.541857 26229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:30.543323 26221 server_base.cc:1034] running on GCE node
I20260805 23:00:30.544234 26221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:30.545884 26221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:30.547109 26221 hybrid_clock.cc:648] HybridClock initialized: now 1785970830547052 us; error 41 us; skew 500 ppm
I20260805 23:00:30.547484 26221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:30 dist-test-slave-1vmg krb5kdc[26202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970830, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:30.550837 26221 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:30.552613 26221 webserver.cc:460] Webserver started at http://127.22.45.126:45353/ using document root <none> and password file <none>
I20260805 23:00:30.553393 26221 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:30.553516 26221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:30.553877 26221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:30.557253 26221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "871b12af4e2147089d18b10a34bd70c9"
format_stamp: "Formatted at 2026-08-05 23:00:30 on dist-test-slave-1vmg"
server_key: "05c2d21b98034300d0db0d9e57108058"
server_key_iv: "bb1b7379282a00087b8d399afac353c8"
server_key_version: "encryptionkey@0"
I20260805 23:00:30.558120 26221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "871b12af4e2147089d18b10a34bd70c9"
format_stamp: "Formatted at 2026-08-05 23:00:30 on dist-test-slave-1vmg"
server_key: "05c2d21b98034300d0db0d9e57108058"
server_key_iv: "bb1b7379282a00087b8d399afac353c8"
server_key_version: "encryptionkey@0"
I20260805 23:00:30.563958 26221 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260805 23:00:30.567802 26242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:30.569264 26221 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:00:30.569455 26221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "871b12af4e2147089d18b10a34bd70c9"
format_stamp: "Formatted at 2026-08-05 23:00:30 on dist-test-slave-1vmg"
server_key: "05c2d21b98034300d0db0d9e57108058"
server_key_iv: "bb1b7379282a00087b8d399afac353c8"
server_key_version: "encryptionkey@0"
I20260805 23:00:30.569679 26221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:30.597330 26221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:30.602082 26221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:30.602408 26221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:30.621794 26221 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:44759
I20260805 23:00:30.621814 26313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:44759 every 8 connection(s)
I20260805 23:00:30.623427 26221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:30.627553 26314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:30.633107 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 26221
I20260805 23:00:30.633337 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:30.633981 22709 external_mini_cluster.cc:1428] Setting key 2fe8f831b229692afaf127b47d3aaa72
I20260805 23:00:30.640210 26314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9: Bootstrap starting.
I20260805 23:00:30.644325 26314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:30.645521 26314 log.cc:824] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:30.648900 26314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9: No bootstrap required, opened a new log
Aug 05 23:00:30 dist-test-slave-1vmg krb5kdc[26202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:30.657352 26314 raft_consensus.cc:348] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12af4e2147089d18b10a34bd70c9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 44759 } }
I20260805 23:00:30.657786 26314 raft_consensus.cc:374] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:30.657891 26314 raft_consensus.cc:729] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 871b12af4e2147089d18b10a34bd70c9, State: Initialized, Role: FOLLOWER
I20260805 23:00:30.658722 26314 consensus_queue.cc:260] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12af4e2147089d18b10a34bd70c9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 44759 } }
I20260805 23:00:30.659098 26314 raft_consensus.cc:388] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:30.659271 26314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:30.659480 26314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:30.660602 26319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:30.636316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34690 (local address 127.22.45.126:44759)
0805 23:00:30.637258 (+ 942us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:30.637276 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:30.637330 (+ 54us) server_negotiation.cc:407] Connection header received
0805 23:00:30.639855 (+ 2525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:30.639887 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:30.640466 (+ 579us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:30.640976 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:30.642436 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:30.644476 (+ 2040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:30.645861 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:30.647052 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:30.647248 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:30.651693 (+ 4445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:30.651703 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:30.651734 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:30.651779 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:30.655290 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:30.656156 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:30.656169 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:30.656177 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:30.656390 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:30.656784 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:30.656788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:30.656790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:30.657410 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:30.657727 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:30.658284 (+ 557us) server_negotiation.cc:299] Negotiation successful
0805 23:00:30.658821 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":405,"threads_started":1}
I20260805 23:00:30.662492 26314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12af4e2147089d18b10a34bd70c9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 44759 } }
I20260805 23:00:30.663123 26314 leader_election.cc:302] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 871b12af4e2147089d18b10a34bd70c9; no voters:
I20260805 23:00:30.663837 26314 leader_election.cc:288] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:30.663945 26323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:30.664572 26323 raft_consensus.cc:686] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [term 1 LEADER]: Becoming Leader. State: Replica: 871b12af4e2147089d18b10a34bd70c9, State: Running, Role: LEADER
I20260805 23:00:30.665256 26323 consensus_queue.cc:237] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12af4e2147089d18b10a34bd70c9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 44759 } }
I20260805 23:00:30.666374 26314 sys_catalog.cc:564] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:30.668705 26327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "871b12af4e2147089d18b10a34bd70c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12af4e2147089d18b10a34bd70c9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 44759 } } }
I20260805 23:00:30.668771 26328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 871b12af4e2147089d18b10a34bd70c9. Latest consensus state: current_term: 1 leader_uuid: "871b12af4e2147089d18b10a34bd70c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "871b12af4e2147089d18b10a34bd70c9" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 44759 } } }
I20260805 23:00:30.669149 26327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:30.669148 26328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:30.672175 26332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:30.678210 26332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:30.688490 26332 catalog_manager.cc:1347] Generated new cluster ID: 4e745e9deb45455691e43b46a3f67ece
I20260805 23:00:30.688671 26332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:30.701843 26332 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:30.704169 26332 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:30.720674 26332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 871b12af4e2147089d18b10a34bd70c9: Generated new TSK 0
I20260805 23:00:30.722082 26332 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:30.780835 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:44759
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:31.156589 26351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:31.156955 26351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:31.157099 26351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:31.165328 26351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:31.165495 26351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:31.165675 26351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:31.176841 26351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:44759
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:31.178360 26351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:31.179936 26351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:31.194393 26357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:31.194357 26359 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:31.194428 26361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:31.195348 26351 server_base.cc:1034] running on GCE node
I20260805 23:00:31.196063 26351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:31.197193 26351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:31.198462 26351 hybrid_clock.cc:648] HybridClock initialized: now 1785970831198404 us; error 56 us; skew 500 ppm
I20260805 23:00:31.198855 26351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:31 dist-test-slave-1vmg krb5kdc[26202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970831, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:31.202698 26351 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:31.204440 26351 webserver.cc:460] Webserver started at http://127.22.45.65:44141/ using document root <none> and password file <none>
I20260805 23:00:31.205240 26351 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:31.205374 26351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:31.205710 26351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:31.209116 26351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "248cea8b88b24e348f66b1d9d029c942"
format_stamp: "Formatted at 2026-08-05 23:00:31 on dist-test-slave-1vmg"
server_key: "2ef0fceeb5b7bcbd3b7e1d7c1ab12d6a"
server_key_iv: "4dbbf528b2c336cb3de9d7cfc6602b1e"
server_key_version: "encryptionkey@0"
I20260805 23:00:31.210035 26351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "248cea8b88b24e348f66b1d9d029c942"
format_stamp: "Formatted at 2026-08-05 23:00:31 on dist-test-slave-1vmg"
server_key: "2ef0fceeb5b7bcbd3b7e1d7c1ab12d6a"
server_key_iv: "4dbbf528b2c336cb3de9d7cfc6602b1e"
server_key_version: "encryptionkey@0"
I20260805 23:00:31.216393 26351 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260805 23:00:31.220813 26370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:31.222470 26351 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:00:31.222692 26351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "248cea8b88b24e348f66b1d9d029c942"
format_stamp: "Formatted at 2026-08-05 23:00:31 on dist-test-slave-1vmg"
server_key: "2ef0fceeb5b7bcbd3b7e1d7c1ab12d6a"
server_key_iv: "4dbbf528b2c336cb3de9d7cfc6602b1e"
server_key_version: "encryptionkey@0"
I20260805 23:00:31.222956 26351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:31.241559 26351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:31.246400 26351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:31.246718 26351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:31.247912 26351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:31.249645 26351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:31.249732 26351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:31.249836 26351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:31.249881 26351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:31.282992 26351 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:40291
I20260805 23:00:31.283020 26526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:40291 every 8 connection(s)
I20260805 23:00:31.284520 26351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:31.286664 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 26351
I20260805 23:00:31.286898 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:31.287750 22709 external_mini_cluster.cc:1428] Setting key 04dad6c49f9d969711543756309b0740
Aug 05 23:00:31 dist-test-slave-1vmg krb5kdc[26202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970831, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:00:31.310470 26529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:31.287647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:35949 (local address 127.22.45.126:44759)
0805 23:00:31.290386 (+ 2739us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:31.290390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:31.290410 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:00:31.292546 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:31.292552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:31.292653 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:31.292757 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:31.295368 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.296192 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.298728 (+ 2536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.299258 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.299411 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:31.303836 (+ 4425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:31.303843 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:31.303846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:31.303886 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:31.306771 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:31.307787 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:31.307792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:31.307794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:31.307936 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:31.308460 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:31.308464 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:31.308466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:31.308786 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:31.308933 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:31.309820 (+ 887us) server_negotiation.cc:299] Negotiation successful
0805 23:00:31.310086 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2626,"thread_start_us":2508,"threads_started":1}
I20260805 23:00:31.311795 26530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:31.288364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:44759 (local address 127.22.45.65:35949)
0805 23:00:31.289496 (+ 1132us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:31.289557 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:31.292123 (+ 2566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:31.293121 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:31.293135 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:31.294007 (+ 872us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:31.295017 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:31.295051 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.296420 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.296425 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:31.298405 (+ 1980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:31.298425 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.299573 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.299582 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:31.299883 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:31.300640 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:31.300667 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:31.303497 (+ 2830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:31.307033 (+ 3536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:31.307043 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:31.307062 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:31.307622 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:31.308067 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:31.308073 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:31.308077 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:31.308325 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:31.308935 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:31.308945 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:31.309372 (+ 427us) client_negotiation.cc:769] Sending connection context
0805 23:00:31.309668 (+ 296us) client_negotiation.cc:240] Negotiation successful
0805 23:00:31.310319 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":753,"thread_start_us":409,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
I20260805 23:00:31.313736 26527 heartbeater.cc:347] Connected to a master server at 127.22.45.126:44759
I20260805 23:00:31.314117 26527 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:31.315075 26527 heartbeater.cc:511] Master 127.22.45.126:44759 requested a full tablet report, sending...
I20260805 23:00:31.317878 26263 ts_manager.cc:194] Registered new tserver with Master: 248cea8b88b24e348f66b1d9d029c942 (127.22.45.65:40291)
I20260805 23:00:31.320169 26263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:35949
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:31.341779 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:44759
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:31.699335 26533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:31.699688 26533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:31.699824 26533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:31.707629 26533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:31.707789 26533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:31.707916 26533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:31.718586 26533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:44759
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:31.720429 26533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:31.722133 26533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:31.737381 26539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:31.737417 26544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:31.737460 26540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:31.738444 26533 server_base.cc:1034] running on GCE node
I20260805 23:00:31.739210 26533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:31.740346 26533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:31.741606 26533 hybrid_clock.cc:648] HybridClock initialized: now 1785970831741558 us; error 57 us; skew 500 ppm
I20260805 23:00:31.741979 26533 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:31 dist-test-slave-1vmg krb5kdc[26202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970831, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:31.745754 26533 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:31.748271 26533 webserver.cc:460] Webserver started at http://127.22.45.66:45671/ using document root <none> and password file <none>
I20260805 23:00:31.749481 26533 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:31.749650 26533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:31.750088 26533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:31.753674 26533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "6f7693b4a83e4fac9a7dfb415a2c42d6"
format_stamp: "Formatted at 2026-08-05 23:00:31 on dist-test-slave-1vmg"
server_key: "c431d41e95d727b459321f447e2c10d7"
server_key_iv: "6c572d83e8682b9a10798cd195fc0756"
server_key_version: "encryptionkey@0"
I20260805 23:00:31.754908 26533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "6f7693b4a83e4fac9a7dfb415a2c42d6"
format_stamp: "Formatted at 2026-08-05 23:00:31 on dist-test-slave-1vmg"
server_key: "c431d41e95d727b459321f447e2c10d7"
server_key_iv: "6c572d83e8682b9a10798cd195fc0756"
server_key_version: "encryptionkey@0"
I20260805 23:00:31.761590 26533 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:00:31.765812 26556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:31.767549 26533 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 23:00:31.767732 26533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "6f7693b4a83e4fac9a7dfb415a2c42d6"
format_stamp: "Formatted at 2026-08-05 23:00:31 on dist-test-slave-1vmg"
server_key: "c431d41e95d727b459321f447e2c10d7"
server_key_iv: "6c572d83e8682b9a10798cd195fc0756"
server_key_version: "encryptionkey@0"
I20260805 23:00:31.767937 26533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:31.789526 26533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:31.794862 26533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:31.795253 26533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:31.796412 26533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:31.798051 26533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:31.798138 26533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:31.798243 26533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:31.798290 26533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:31.834162 26533 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:37493
I20260805 23:00:31.834239 26711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:37493 every 8 connection(s)
I20260805 23:00:31.835651 26533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:31.836092 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 26533
I20260805 23:00:31.836282 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:31.836992 22709 external_mini_cluster.cc:1428] Setting key ee1bfe34bffd0d9e7318356e54063afd
Aug 05 23:00:31 dist-test-slave-1vmg krb5kdc[26202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970831, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:00:31.862077 26714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:31.838558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:34473 (local address 127.22.45.126:44759)
0805 23:00:31.839074 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:31.839080 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:31.840588 (+ 1508us) server_negotiation.cc:407] Connection header received
0805 23:00:31.842661 (+ 2073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:31.842667 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:31.842776 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:31.842904 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:31.845795 (+ 2891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.846612 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.849381 (+ 2769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.849950 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.850080 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:31.855168 (+ 5088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:31.855174 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:31.855177 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:31.855219 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:31.858190 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:31.859426 (+ 1236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:31.859431 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:31.859433 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:31.859604 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:31.860147 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:31.860150 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:31.860152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:31.860457 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:31.860580 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:31.861490 (+ 910us) server_negotiation.cc:299] Negotiation successful
0805 23:00:31.861723 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":259,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
I20260805 23:00:31.863318 26716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:31.839448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:44759 (local address 127.22.45.66:34473)
0805 23:00:31.840386 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:31.840447 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:31.842314 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:31.843515 (+ 1201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:31.843529 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:31.844651 (+ 1122us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:31.845478 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:31.845512 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.846861 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.846867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:31.849122 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:31.849149 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:31.850262 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:31.850271 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:31.850606 (+ 335us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:31.851529 (+ 923us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:31.851574 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:31.854748 (+ 3174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:31.858410 (+ 3662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:31.858423 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:31.858447 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:31.859254 (+ 807us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:31.859771 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:31.859776 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:31.859780 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:31.860045 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:31.860641 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:31.860649 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:31.861082 (+ 433us) client_negotiation.cc:769] Sending connection context
0805 23:00:31.861353 (+ 271us) client_negotiation.cc:240] Negotiation successful
0805 23:00:31.861865 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":364,"threads_started":1}
I20260805 23:00:31.865015 26712 heartbeater.cc:347] Connected to a master server at 127.22.45.126:44759
I20260805 23:00:31.865386 26712 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:31.866394 26712 heartbeater.cc:511] Master 127.22.45.126:44759 requested a full tablet report, sending...
I20260805 23:00:31.868207 26263 ts_manager.cc:194] Registered new tserver with Master: 6f7693b4a83e4fac9a7dfb415a2c42d6 (127.22.45.66:37493)
I20260805 23:00:31.869072 26263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:34473
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:31.890120 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:44759
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34803
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:32.249782 26719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:32.250140 26719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:32.250308 26719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:32.258189 26719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:32.258368 26719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:32.258558 26719 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:32.269665 26719 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34803
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:44759
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:32.271246 26719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:32.272990 26719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:32.288512 26734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:32.288830 26732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:32.289059 26730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:32.289613 26719 server_base.cc:1034] running on GCE node
I20260805 23:00:32.290365 26719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:32.291575 26719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:32.292841 26719 hybrid_clock.cc:648] HybridClock initialized: now 1785970832292784 us; error 50 us; skew 500 ppm
I20260805 23:00:32.293219 26719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:32 dist-test-slave-1vmg krb5kdc[26202](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970832, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:32.296995 26719 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:32.298745 26719 webserver.cc:460] Webserver started at http://127.22.45.67:37845/ using document root <none> and password file <none>
I20260805 23:00:32.299796 26719 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:32.299988 26719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:32.300374 26719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:32.304337 26719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "d634a8db643141a1950ae28b1ebae373"
format_stamp: "Formatted at 2026-08-05 23:00:32 on dist-test-slave-1vmg"
server_key: "746306b600dbae769e4cb0981b68c10d"
server_key_iv: "de055fbef95377e6d7decd3b8992441f"
server_key_version: "encryptionkey@0"
I20260805 23:00:32.305335 26719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "d634a8db643141a1950ae28b1ebae373"
format_stamp: "Formatted at 2026-08-05 23:00:32 on dist-test-slave-1vmg"
server_key: "746306b600dbae769e4cb0981b68c10d"
server_key_iv: "de055fbef95377e6d7decd3b8992441f"
server_key_version: "encryptionkey@0"
I20260805 23:00:32.311568 26719 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 23:00:32.316025 26743 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:32.317654 26719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260805 23:00:32.317862 26719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "d634a8db643141a1950ae28b1ebae373"
format_stamp: "Formatted at 2026-08-05 23:00:32 on dist-test-slave-1vmg"
server_key: "746306b600dbae769e4cb0981b68c10d"
server_key_iv: "de055fbef95377e6d7decd3b8992441f"
server_key_version: "encryptionkey@0"
I20260805 23:00:32.318112 26719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:32.324275 26527 heartbeater.cc:503] Master 127.22.45.126:44759 was elected leader, sending a full tablet report...
I20260805 23:00:32.334331 26719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:32.339382 26719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:32.339887 26719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:32.341138 26719 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:32.342850 26719 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:32.342988 26719 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260805 23:00:32.343117 26719 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:32.343199 26719 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:32.380106 26719 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:33523
I20260805 23:00:32.380148 26893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:33523 every 8 connection(s)
I20260805 23:00:32.381695 26719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:32.384588 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 26719
I20260805 23:00:32.384814 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:32.385350 22709 external_mini_cluster.cc:1428] Setting key 5e492c9c2af1845cb4669ab23142eb27
Aug 05 23:00:32 dist-test-slave-1vmg krb5kdc[26202](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970832, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:32.404889 26896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:32.384854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:59213 (local address 127.22.45.126:44759)
0805 23:00:32.385446 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:32.385452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:32.386622 (+ 1170us) server_negotiation.cc:407] Connection header received
0805 23:00:32.388975 (+ 2353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:32.388980 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:32.389088 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:32.389188 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:32.391242 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:32.392191 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:32.393852 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:32.394293 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:32.394396 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:32.398186 (+ 3790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:32.398194 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:32.398198 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:32.398237 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:32.401332 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:32.402376 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:32.402381 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:32.402383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:32.402523 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:32.403040 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:32.403044 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:32.403047 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:32.403390 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:32.403535 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:32.404360 (+ 825us) server_negotiation.cc:299] Negotiation successful
0805 23:00:32.404577 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":292,"threads_started":1}
I20260805 23:00:32.405901 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:32.385517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:44759 (local address 127.22.45.67:59213)
0805 23:00:32.386443 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:32.386510 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:32.388684 (+ 2174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:32.389514 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:32.389528 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:32.390165 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:32.391014 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:32.391047 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:32.392354 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:32.392359 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:32.393691 (+ 1332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:32.393705 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:32.394504 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:32.394509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:32.394735 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:32.395471 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:32.395497 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:32.397904 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:32.401536 (+ 3632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:32.401547 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:32.401575 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:32.402229 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:32.402614 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:32.402618 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:32.402620 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:32.402831 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:32.403545 (+ 714us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:32.403553 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:32.403954 (+ 401us) client_negotiation.cc:769] Sending connection context
0805 23:00:32.404227 (+ 273us) client_negotiation.cc:240] Negotiation successful
0805 23:00:32.404671 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":370,"threads_started":1}
I20260805 23:00:32.407543 26894 heartbeater.cc:347] Connected to a master server at 127.22.45.126:44759
I20260805 23:00:32.407863 26894 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:32.408623 26894 heartbeater.cc:511] Master 127.22.45.126:44759 requested a full tablet report, sending...
I20260805 23:00:32.410236 26263 ts_manager.cc:194] Registered new tserver with Master: d634a8db643141a1950ae28b1ebae373 (127.22.45.67:33523)
I20260805 23:00:32.411115 26263 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:59213
I20260805 23:00:32.416566 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 23:00:32.454795 26896 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:32.451690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34698 (local address 127.22.45.126:44759)
0805 23:00:32.451913 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:32.451920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:32.452320 (+ 400us) server_negotiation.cc:407] Connection header received
0805 23:00:32.452545 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:32.452552 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:32.452740 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:32.452891 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:32.454535 (+ 1644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34698: BlockingRecv error: recv got EOF from 127.0.0.1:34698 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:00:32.458876 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26351
W20260805 23:00:32.462137 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26351: Not authorized: Client connection negotiation failed: client connection to 127.22.45.65:40291: server requires authentication, but client does not have Kerberos credentials available
I20260805 23:00:32.462354 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 26351
I20260805 23:00:32.479574 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26533
W20260805 23:00:32.483229 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26533: Not authorized: Client connection negotiation failed: client connection to 127.22.45.66:37493: server requires authentication, but client does not have Kerberos credentials available
I20260805 23:00:32.483412 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 26533
I20260805 23:00:32.505317 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26719
W20260805 23:00:32.508586 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26719: Not authorized: Client connection negotiation failed: client connection to 127.22.45.67:33523: server requires authentication, but client does not have Kerberos credentials available
I20260805 23:00:32.508759 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 26719
I20260805 23:00:32.530632 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26221
I20260805 23:00:32.532148 26308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:32.642060 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 26221
2026-08-05T23:00:32Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3939 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:32 dist-test-slave-1vmg krb5kdc[26922](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:32 dist-test-slave-1vmg krb5kdc[26922](info): set up 2 sockets
Aug 05 23:00:32 dist-test-slave-1vmg krb5kdc[26922](info): commencing operation
krb5kdc: starting...
W20260805 23:00:33.829943 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:33 dist-test-slave-1vmg krb5kdc[26922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:34.059100 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45381
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:43003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:45381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:34.429972 26940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:34.430351 26940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:34.430473 26940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:34.438258 26940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:34.438416 26940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:34.438464 26940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:34.438547 26940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:34.438617 26940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:34.449513 26940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:45381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:34.451138 26940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:34.452661 26940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:34.466516 26947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:34.466605 26948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:34.466764 26952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:34.468442 26940 server_base.cc:1034] running on GCE node
I20260805 23:00:34.469729 26940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:34.471871 26940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:34.473199 26940 hybrid_clock.cc:648] HybridClock initialized: now 1785970834473133 us; error 61 us; skew 500 ppm
I20260805 23:00:34.473690 26940 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:34 dist-test-slave-1vmg krb5kdc[26922](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970834, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:34.482671 26940 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:34.484587 26940 webserver.cc:460] Webserver started at http://127.22.45.126:37633/ using document root <none> and password file <none>
I20260805 23:00:34.485419 26940 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:34.485569 26940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:34.485926 26940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:34.489450 26940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "67314a15246d4fbd86082dcf7f232987"
format_stamp: "Formatted at 2026-08-05 23:00:34 on dist-test-slave-1vmg"
server_key: "83469f7f2a3215d7cdf1dab73e8ec10d"
server_key_iv: "419f0578622b6bf5812818c785b97c7d"
server_key_version: "encryptionkey@0"
I20260805 23:00:34.490423 26940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "67314a15246d4fbd86082dcf7f232987"
format_stamp: "Formatted at 2026-08-05 23:00:34 on dist-test-slave-1vmg"
server_key: "83469f7f2a3215d7cdf1dab73e8ec10d"
server_key_iv: "419f0578622b6bf5812818c785b97c7d"
server_key_version: "encryptionkey@0"
I20260805 23:00:34.497484 26940 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260805 23:00:34.501803 26961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:34.504139 26940 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260805 23:00:34.504371 26940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "67314a15246d4fbd86082dcf7f232987"
format_stamp: "Formatted at 2026-08-05 23:00:34 on dist-test-slave-1vmg"
server_key: "83469f7f2a3215d7cdf1dab73e8ec10d"
server_key_iv: "419f0578622b6bf5812818c785b97c7d"
server_key_version: "encryptionkey@0"
I20260805 23:00:34.504616 26940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:34.525362 26940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:34.530743 26940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:34.531134 26940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:34.551302 26940 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:45381
I20260805 23:00:34.551342 27034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:45381 every 8 connection(s)
I20260805 23:00:34.552852 26940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:34.554391 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 26940
I20260805 23:00:34.554648 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:34.555523 22709 external_mini_cluster.cc:1428] Setting key a96cb55500183ffde7dbf09d14a4eb27
I20260805 23:00:34.558063 27035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:00:34 dist-test-slave-1vmg krb5kdc[26922](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970833, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:34.570720 27035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987: Bootstrap starting.
I20260805 23:00:34.575455 27035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:34.576987 27035 log.cc:824] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:34.581153 27035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987: No bootstrap required, opened a new log
I20260805 23:00:34.582824 27038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:34.557769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49792 (local address 127.22.45.126:45381)
0805 23:00:34.558889 (+ 1120us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:34.558903 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:34.558993 (+ 90us) server_negotiation.cc:407] Connection header received
0805 23:00:34.560787 (+ 1794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:34.560813 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:34.561304 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:34.561765 (+ 461us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:34.563454 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:34.564869 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:34.566189 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:34.566974 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:34.567217 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:34.571894 (+ 4677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:34.571907 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:34.571929 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:34.571992 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:34.576645 (+ 4653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:34.577669 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:34.577680 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:34.577694 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:34.577919 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:34.578447 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:34.578452 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:34.578455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:34.579395 (+ 940us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:34.579754 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:34.580305 (+ 551us) server_negotiation.cc:299] Negotiation successful
0805 23:00:34.580829 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":859,"thread_start_us":603,"threads_started":1}
I20260805 23:00:34.588243 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:00:34.594206 27035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67314a15246d4fbd86082dcf7f232987" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45381 } }
I20260805 23:00:34.594799 27035 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:34.594959 27035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67314a15246d4fbd86082dcf7f232987, State: Initialized, Role: FOLLOWER
I20260805 23:00:34.595743 27035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67314a15246d4fbd86082dcf7f232987" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45381 } }
I20260805 23:00:34.596064 27035 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:34.596220 27035 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:34.596400 27035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:34.599560 27035 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67314a15246d4fbd86082dcf7f232987" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45381 } }
I20260805 23:00:34.600234 27035 leader_election.cc:302] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67314a15246d4fbd86082dcf7f232987; no voters:
I20260805 23:00:34.600932 27035 leader_election.cc:288] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:34.601061 27041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:34.602174 27041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [term 1 LEADER]: Becoming Leader. State: Replica: 67314a15246d4fbd86082dcf7f232987, State: Running, Role: LEADER
I20260805 23:00:34.602939 27041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67314a15246d4fbd86082dcf7f232987" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45381 } }
I20260805 23:00:34.603600 27035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:34.606451 27044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67314a15246d4fbd86082dcf7f232987. Latest consensus state: current_term: 1 leader_uuid: "67314a15246d4fbd86082dcf7f232987" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67314a15246d4fbd86082dcf7f232987" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45381 } } }
I20260805 23:00:34.607266 27044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:34.606706 27043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67314a15246d4fbd86082dcf7f232987" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67314a15246d4fbd86082dcf7f232987" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45381 } } }
I20260805 23:00:34.607616 27043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:34.608338 27051 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:34.617851 27051 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:34.629807 27051 catalog_manager.cc:1347] Generated new cluster ID: 71cb96668c0640468d17a75123069f76
I20260805 23:00:34.630002 27051 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:34.644467 27051 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:34.646312 27051 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:34.646903 27038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:34.637135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36302 (local address 127.22.45.126:45381)
0805 23:00:34.637315 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:34.637321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:34.638029 (+ 708us) server_negotiation.cc:407] Connection header received
0805 23:00:34.638217 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:34.638224 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:34.638320 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:34.638443 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:34.639808 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:34.641120 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:34.642710 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:34.643337 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:34.643475 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:34.644947 (+ 1472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:34.644954 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:34.644962 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:34.645890 (+ 928us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:34.645961 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:34.645993 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:34.646122 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:34.646292 (+ 170us) server_negotiation.cc:299] Negotiation successful
0805 23:00:34.646479 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":63}
I20260805 23:00:34.653821 27051 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67314a15246d4fbd86082dcf7f232987: Generated new TSK 0
I20260805 23:00:34.655807 27051 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:00:34.667641 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 26940
I20260805 23:00:34.669584 27029 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:34.762243 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 26940
2026-08-05T23:00:34Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2110 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:34 dist-test-slave-1vmg krb5kdc[27083](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:34 dist-test-slave-1vmg krb5kdc[27083](info): set up 2 sockets
Aug 05 23:00:34 dist-test-slave-1vmg krb5kdc[27083](info): commencing operation
krb5kdc: starting...
W20260805 23:00:35.946360 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:36 dist-test-slave-1vmg krb5kdc[27083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:36.184496 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43509
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:35159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:43509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:36.547766 27098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:36.548146 27098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:36.548290 27098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:36.556046 27098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:36.556216 27098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:36.556294 27098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:36.556383 27098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:36.556447 27098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:36.567555 27098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:35159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:43509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:36.569309 27098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:36.570779 27098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:36.583787 27104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:36.583767 27107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:36.584017 27109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:36.584738 27098 server_base.cc:1034] running on GCE node
I20260805 23:00:36.585635 27098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:36.587307 27098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:36.588555 27098 hybrid_clock.cc:648] HybridClock initialized: now 1785970836588473 us; error 69 us; skew 500 ppm
I20260805 23:00:36.588927 27098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:36 dist-test-slave-1vmg krb5kdc[27083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970836, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:36.592489 27098 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:36.594262 27098 webserver.cc:460] Webserver started at http://127.22.45.126:40387/ using document root <none> and password file <none>
I20260805 23:00:36.595116 27098 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:36.595263 27098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:36.595597 27098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:36.599255 27098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "1ebb005320124ff39f6c4e24008bc715"
format_stamp: "Formatted at 2026-08-05 23:00:36 on dist-test-slave-1vmg"
server_key: "53b28ff8f65fb8d2c1dba662484f5a68"
server_key_iv: "dcea505d08dc9eb9e094665604786c2b"
server_key_version: "encryptionkey@0"
I20260805 23:00:36.600281 27098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "1ebb005320124ff39f6c4e24008bc715"
format_stamp: "Formatted at 2026-08-05 23:00:36 on dist-test-slave-1vmg"
server_key: "53b28ff8f65fb8d2c1dba662484f5a68"
server_key_iv: "dcea505d08dc9eb9e094665604786c2b"
server_key_version: "encryptionkey@0"
I20260805 23:00:36.606957 27098 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:36.611322 27118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:36.612931 27098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:00:36.613125 27098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "1ebb005320124ff39f6c4e24008bc715"
format_stamp: "Formatted at 2026-08-05 23:00:36 on dist-test-slave-1vmg"
server_key: "53b28ff8f65fb8d2c1dba662484f5a68"
server_key_iv: "dcea505d08dc9eb9e094665604786c2b"
server_key_version: "encryptionkey@0"
I20260805 23:00:36.613348 27098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:36.629475 27098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:36.634444 27098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:36.634774 27098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:36.653373 27098 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:43509
I20260805 23:00:36.653414 27194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:43509 every 8 connection(s)
I20260805 23:00:36.654793 27098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:36.658762 27195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:36.659929 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 27098
I20260805 23:00:36.660115 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:36.660775 22709 external_mini_cluster.cc:1428] Setting key 7998a5d2dc7592f8ebf18c4862657042
I20260805 23:00:36.674418 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715: Bootstrap starting.
Aug 05 23:00:36 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970836, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:36.678426 27195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:36.680267 27195 log.cc:824] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:36.684281 27195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715: No bootstrap required, opened a new log
I20260805 23:00:36.687695 27198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:36.663044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51896 (local address 127.22.45.126:43509)
0805 23:00:36.664161 (+ 1117us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:36.664180 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:36.664244 (+ 64us) server_negotiation.cc:407] Connection header received
0805 23:00:36.666034 (+ 1790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:36.666070 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:36.666750 (+ 680us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:36.667331 (+ 581us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:36.668846 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:36.671000 (+ 2154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:36.672452 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:36.673592 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:36.673823 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:36.678486 (+ 4663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:36.678499 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:36.678524 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:36.678596 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:36.682638 (+ 4042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:36.683731 (+ 1093us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:36.683739 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:36.683746 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:36.683951 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:36.684462 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:36.684467 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:36.684470 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:36.685159 (+ 689us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:36.685439 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:36.685932 (+ 493us) server_negotiation.cc:299] Negotiation successful
0805 23:00:36.686376 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":822,"thread_start_us":554,"threads_started":1}
I20260805 23:00:36.693725 27195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebb005320124ff39f6c4e24008bc715" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43509 } }
I20260805 23:00:36.694185 27195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:36.694298 27195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ebb005320124ff39f6c4e24008bc715, State: Initialized, Role: FOLLOWER
I20260805 23:00:36.694970 27195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebb005320124ff39f6c4e24008bc715" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43509 } }
I20260805 23:00:36.695212 27195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:36.695351 27195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:36.695515 27195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:36.697839 27195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebb005320124ff39f6c4e24008bc715" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43509 } }
I20260805 23:00:36.698452 27195 leader_election.cc:302] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ebb005320124ff39f6c4e24008bc715; no voters:
I20260805 23:00:36.699158 27195 leader_election.cc:288] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:36.699276 27201 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:36.700829 27201 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [term 1 LEADER]: Becoming Leader. State: Replica: 1ebb005320124ff39f6c4e24008bc715, State: Running, Role: LEADER
I20260805 23:00:36.701406 27201 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebb005320124ff39f6c4e24008bc715" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43509 } }
I20260805 23:00:36.702042 27195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:36.704386 27202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ebb005320124ff39f6c4e24008bc715" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebb005320124ff39f6c4e24008bc715" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43509 } } }
I20260805 23:00:36.704505 27203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ebb005320124ff39f6c4e24008bc715. Latest consensus state: current_term: 1 leader_uuid: "1ebb005320124ff39f6c4e24008bc715" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ebb005320124ff39f6c4e24008bc715" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43509 } } }
I20260805 23:00:36.704816 27202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:36.704967 27203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:36.707955 27212 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:36.713119 27212 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:36.723269 27212 catalog_manager.cc:1347] Generated new cluster ID: 7d9d9257d85e4e09aac137431b229f9b
I20260805 23:00:36.723425 27212 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:36.755164 27212 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:36.756693 27212 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:36.767405 27212 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ebb005320124ff39f6c4e24008bc715: Generated new TSK 0
I20260805 23:00:36.768776 27212 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:36.831203 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:43509
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:35159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:37.199055 27231 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:37.199415 27231 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:37.199563 27231 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:37.207986 27231 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:37.208127 27231 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:37.208274 27231 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:37.219348 27231 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:35159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:43509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:37.220896 27231 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:37.222365 27231 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:37.237506 27238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:37.237560 27241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:37.237574 27243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:37.238399 27231 server_base.cc:1034] running on GCE node
I20260805 23:00:37.239187 27231 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:37.240402 27231 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:37.241643 27231 hybrid_clock.cc:648] HybridClock initialized: now 1785970837241582 us; error 52 us; skew 500 ppm
I20260805 23:00:37.242041 27231 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:37 dist-test-slave-1vmg krb5kdc[27083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970837, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:37.245784 27231 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:37.247635 27231 webserver.cc:460] Webserver started at http://127.22.45.65:40281/ using document root <none> and password file <none>
I20260805 23:00:37.248453 27231 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:37.248594 27231 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:37.248940 27231 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:37.252606 27231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "48a856af6553499eb41e5c4502372bc7"
format_stamp: "Formatted at 2026-08-05 23:00:37 on dist-test-slave-1vmg"
server_key: "a297419d1dc5d2675e07b8f55e6875b2"
server_key_iv: "9218673f78a0fdefcccdb4960c727fc7"
server_key_version: "encryptionkey@0"
I20260805 23:00:37.253615 27231 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "48a856af6553499eb41e5c4502372bc7"
format_stamp: "Formatted at 2026-08-05 23:00:37 on dist-test-slave-1vmg"
server_key: "a297419d1dc5d2675e07b8f55e6875b2"
server_key_iv: "9218673f78a0fdefcccdb4960c727fc7"
server_key_version: "encryptionkey@0"
I20260805 23:00:37.260351 27231 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:00:37.264837 27254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:37.266634 27231 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260805 23:00:37.266870 27231 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "48a856af6553499eb41e5c4502372bc7"
format_stamp: "Formatted at 2026-08-05 23:00:37 on dist-test-slave-1vmg"
server_key: "a297419d1dc5d2675e07b8f55e6875b2"
server_key_iv: "9218673f78a0fdefcccdb4960c727fc7"
server_key_version: "encryptionkey@0"
I20260805 23:00:37.267175 27231 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:37.295682 27231 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:37.300772 27231 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:37.301121 27231 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:37.302261 27231 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:37.303946 27231 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:37.304032 27231 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:37.304159 27231 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:37.304221 27231 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:37.340621 27231 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:36167
I20260805 23:00:37.340665 27412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:36167 every 8 connection(s)
I20260805 23:00:37.342092 27231 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:37.346472 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 27231
I20260805 23:00:37.346711 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:37.347504 22709 external_mini_cluster.cc:1428] Setting key 88bd6bb737eff84d742d92df74425f98
Aug 05 23:00:37 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970837, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:37.363896 27417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:37.344998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:44185 (local address 127.22.45.126:43509)
0805 23:00:37.345501 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:37.345505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:37.346523 (+ 1018us) server_negotiation.cc:407] Connection header received
0805 23:00:37.348671 (+ 2148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:37.348676 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:37.348745 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:37.348841 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:37.350678 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.351458 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.353041 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.353448 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.353567 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:37.357412 (+ 3845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:37.357417 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:37.357421 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:37.357456 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:37.360217 (+ 2761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:37.361217 (+ 1000us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:37.361223 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:37.361225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:37.361374 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:37.361883 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:37.361886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:37.361888 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:37.362167 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:37.362304 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:37.363340 (+ 1036us) server_negotiation.cc:299] Negotiation successful
0805 23:00:37.363545 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":255,"threads_started":1}
I20260805 23:00:37.365402 27418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:37.345571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:43509 (local address 127.22.45.65:44185)
0805 23:00:37.346343 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:37.346387 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:37.348395 (+ 2008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:37.349134 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:37.349146 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:37.349884 (+ 738us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:37.350495 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:37.350513 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.351621 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.351625 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:37.352881 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:37.352894 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.353690 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.353698 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:37.353947 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:37.354620 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:37.354645 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:37.357157 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:37.360370 (+ 3213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:37.360380 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:37.360397 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:37.361000 (+ 603us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:37.361508 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:37.361513 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:37.361516 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:37.361782 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:37.362324 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:37.362333 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:37.362833 (+ 500us) client_negotiation.cc:769] Sending connection context
0805 23:00:37.363197 (+ 364us) client_negotiation.cc:240] Negotiation successful
0805 23:00:37.363821 (+ 624us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":289,"threads_started":1}
I20260805 23:00:37.367229 27414 heartbeater.cc:347] Connected to a master server at 127.22.45.126:43509
I20260805 23:00:37.367563 27414 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:00:37.368405 27414 heartbeater.cc:511] Master 127.22.45.126:43509 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
I20260805 23:00:37.370961 27144 ts_manager.cc:194] Registered new tserver with Master: 48a856af6553499eb41e5c4502372bc7 (127.22.45.65:36167)
I20260805 23:00:37.373126 27144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:44185
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:37.397527 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:43509
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:35159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:37.746486 27421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:37.746833 27421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:37.746965 27421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:37.754639 27421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:37.754796 27421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:37.754968 27421 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:37.765532 27421 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:35159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:43509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:37.767354 27421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:37.768911 27421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:37.786513 27428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:37.786572 27429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:37.786527 27433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:37.787531 27421 server_base.cc:1034] running on GCE node
I20260805 23:00:37.788314 27421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:37.789471 27421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:37.790745 27421 hybrid_clock.cc:648] HybridClock initialized: now 1785970837790694 us; error 53 us; skew 500 ppm
I20260805 23:00:37.791199 27421 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:37 dist-test-slave-1vmg krb5kdc[27083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970837, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:37.795190 27421 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:37.797181 27421 webserver.cc:460] Webserver started at http://127.22.45.66:39149/ using document root <none> and password file <none>
I20260805 23:00:37.798005 27421 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:37.798161 27421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:37.798506 27421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:37.801966 27421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "823ec8c21b554408be09dd7bbc1cd504"
format_stamp: "Formatted at 2026-08-05 23:00:37 on dist-test-slave-1vmg"
server_key: "b065295b501981aa51fe6e7adb7b82f7"
server_key_iv: "d000e12dc9a01af994050ede3c6bc324"
server_key_version: "encryptionkey@0"
I20260805 23:00:37.802896 27421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "823ec8c21b554408be09dd7bbc1cd504"
format_stamp: "Formatted at 2026-08-05 23:00:37 on dist-test-slave-1vmg"
server_key: "b065295b501981aa51fe6e7adb7b82f7"
server_key_iv: "d000e12dc9a01af994050ede3c6bc324"
server_key_version: "encryptionkey@0"
I20260805 23:00:37.809525 27421 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 23:00:37.813947 27447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:37.815622 27421 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 23:00:37.815845 27421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "823ec8c21b554408be09dd7bbc1cd504"
format_stamp: "Formatted at 2026-08-05 23:00:37 on dist-test-slave-1vmg"
server_key: "b065295b501981aa51fe6e7adb7b82f7"
server_key_iv: "d000e12dc9a01af994050ede3c6bc324"
server_key_version: "encryptionkey@0"
I20260805 23:00:37.816064 27421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:37.838039 27421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:37.843226 27421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:37.843573 27421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:37.844780 27421 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:37.846314 27421 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:37.846407 27421 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:37.846540 27421 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:37.846598 27421 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:37.882099 27421 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:32933
I20260805 23:00:37.882135 27608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:32933 every 8 connection(s)
I20260805 23:00:37.883662 27421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:37.890552 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 27421
I20260805 23:00:37.890753 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:37.891287 22709 external_mini_cluster.cc:1428] Setting key 9a4f03717a33ab807bd44450f151a8dd
Aug 05 23:00:37 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970837, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:37.906458 27612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:37.886626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:33589 (local address 127.22.45.126:43509)
0805 23:00:37.887175 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:37.887180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:37.888204 (+ 1024us) server_negotiation.cc:407] Connection header received
0805 23:00:37.890274 (+ 2070us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:37.890280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:37.890374 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:37.890484 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:37.892483 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.893389 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.895124 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.895569 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.895699 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:37.899645 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:37.899651 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:37.899654 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:37.899692 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:37.902798 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:37.903802 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:37.903807 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:37.903809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:37.903960 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:37.904433 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:37.904437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:37.904439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:37.904744 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:37.904911 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:37.905757 (+ 846us) server_negotiation.cc:299] Negotiation successful
0805 23:00:37.906046 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":403,"thread_start_us":288,"threads_started":1}
I20260805 23:00:37.907648 27613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:37.887176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:43509 (local address 127.22.45.66:33589)
0805 23:00:37.888004 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:37.888063 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:37.889929 (+ 1866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:37.890833 (+ 904us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:37.890847 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:37.891534 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:37.892287 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:37.892316 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.893557 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.893560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:37.894952 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:37.894972 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:37.895845 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:37.895853 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:37.896109 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:37.896836 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:37.896867 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:37.899327 (+ 2460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:37.903004 (+ 3677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:37.903016 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:37.903032 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:37.903659 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:37.904078 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:37.904083 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:37.904087 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:37.904306 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:37.904885 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:37.904894 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:37.905311 (+ 417us) client_negotiation.cc:769] Sending connection context
0805 23:00:37.905612 (+ 301us) client_negotiation.cc:240] Negotiation successful
0805 23:00:37.906248 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":311,"threads_started":1}
I20260805 23:00:37.909503 27609 heartbeater.cc:347] Connected to a master server at 127.22.45.126:43509
I20260805 23:00:37.909842 27609 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:37.910686 27609 heartbeater.cc:511] Master 127.22.45.126:43509 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:00:37.912534 27144 ts_manager.cc:194] Registered new tserver with Master: 823ec8c21b554408be09dd7bbc1cd504 (127.22.45.66:32933)
I20260805 23:00:37.913450 27144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:33589
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:37.942656 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:43509
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:35159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:38.292870 27617 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:38.293246 27617 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:38.293407 27617 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:38.301065 27617 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:38.301240 27617 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:38.301409 27617 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:38.312125 27617 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:35159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:43509
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:38.313593 27617 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:38.315094 27617 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:38.329926 27622 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:38.329851 27623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:38.329886 27627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:38.331120 27617 server_base.cc:1034] running on GCE node
I20260805 23:00:38.331851 27617 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:38.332931 27617 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:38.334151 27617 hybrid_clock.cc:648] HybridClock initialized: now 1785970838334093 us; error 55 us; skew 500 ppm
I20260805 23:00:38.334518 27617 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970838, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:38.338138 27617 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:38.339983 27617 webserver.cc:460] Webserver started at http://127.22.45.67:34077/ using document root <none> and password file <none>
I20260805 23:00:38.340770 27617 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:38.340909 27617 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:38.341249 27617 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:38.344625 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "3eb86355673a4fa295e93dbab20f8b5e"
format_stamp: "Formatted at 2026-08-05 23:00:38 on dist-test-slave-1vmg"
server_key: "e0548d115ac1a2f20175c24fe1f490bc"
server_key_iv: "176bc06ef8f9ec96d8c4ee27ce3f98ca"
server_key_version: "encryptionkey@0"
I20260805 23:00:38.345523 27617 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "3eb86355673a4fa295e93dbab20f8b5e"
format_stamp: "Formatted at 2026-08-05 23:00:38 on dist-test-slave-1vmg"
server_key: "e0548d115ac1a2f20175c24fe1f490bc"
server_key_iv: "176bc06ef8f9ec96d8c4ee27ce3f98ca"
server_key_version: "encryptionkey@0"
I20260805 23:00:38.351681 27617 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 23:00:38.355885 27641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:38.357416 27617 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:00:38.357613 27617 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "3eb86355673a4fa295e93dbab20f8b5e"
format_stamp: "Formatted at 2026-08-05 23:00:38 on dist-test-slave-1vmg"
server_key: "e0548d115ac1a2f20175c24fe1f490bc"
server_key_iv: "176bc06ef8f9ec96d8c4ee27ce3f98ca"
server_key_version: "encryptionkey@0"
I20260805 23:00:38.357846 27617 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:38.377384 27414 heartbeater.cc:503] Master 127.22.45.126:43509 was elected leader, sending a full tablet report...
I20260805 23:00:38.379118 27617 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:38.383711 27617 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:38.383985 27617 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:38.385016 27617 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:38.386641 27617 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:38.386730 27617 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:38.386835 27617 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:38.386879 27617 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:38.420437 27617 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:37163
I20260805 23:00:38.420472 27796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:37163 every 8 connection(s)
I20260805 23:00:38.422093 27617 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:38.426548 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 27617
I20260805 23:00:38.426780 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:38.427484 22709 external_mini_cluster.cc:1428] Setting key ca7ea73b70eb88d82b5fe865cbdeba96
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970838, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:38.444670 27800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:38.425120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:46451 (local address 127.22.45.126:43509)
0805 23:00:38.425689 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:38.425696 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:38.426945 (+ 1249us) server_negotiation.cc:407] Connection header received
0805 23:00:38.429132 (+ 2187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:38.429139 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:38.429237 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:38.429357 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:38.431318 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.432124 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.433760 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.434207 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.434311 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:38.438170 (+ 3859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:38.438176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:38.438180 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:38.438237 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:38.440970 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.441948 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.441953 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.441956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.442121 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.442693 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.442698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.442701 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.443138 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:38.443286 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:38.444184 (+ 898us) server_negotiation.cc:299] Negotiation successful
0805 23:00:38.444391 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":252,"threads_started":1}
I20260805 23:00:38.445616 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:38.425784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:43509 (local address 127.22.45.67:46451)
0805 23:00:38.426665 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:38.426742 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:38.428797 (+ 2055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:38.429645 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:38.429659 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:38.430290 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:38.431128 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:38.431155 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.432257 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.432261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:38.433595 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:38.433611 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.434421 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.434426 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:38.434660 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:38.435448 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:38.435480 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:38.437879 (+ 2399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:38.441147 (+ 3268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:38.441157 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:38.441175 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:38.441798 (+ 623us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:38.442261 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:38.442266 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:38.442270 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:38.442559 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:38.443295 (+ 736us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:38.443304 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:38.443809 (+ 505us) client_negotiation.cc:769] Sending connection context
0805 23:00:38.444060 (+ 251us) client_negotiation.cc:240] Negotiation successful
0805 23:00:38.444503 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":393,"threads_started":1}
I20260805 23:00:38.446894 27797 heartbeater.cc:347] Connected to a master server at 127.22.45.126:43509
I20260805 23:00:38.447240 27797 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:38.447989 27797 heartbeater.cc:511] Master 127.22.45.126:43509 requested a full tablet report, sending...
I20260805 23:00:38.449434 27144 ts_manager.cc:194] Registered new tserver with Master: 3eb86355673a4fa295e93dbab20f8b5e (127.22.45.67:37163)
I20260805 23:00:38.450255 27144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:46451
I20260805 23:00:38.456161 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27083](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970838, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970838, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:38.511808 27800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:38.495309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51906 (local address 127.22.45.126:43509)
0805 23:00:38.495640 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:38.495648 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:38.496144 (+ 496us) server_negotiation.cc:407] Connection header received
0805 23:00:38.496351 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:38.496356 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:38.496435 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:38.496533 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:38.498267 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.499302 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.500938 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.501383 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.501501 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:38.506158 (+ 4657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:38.506165 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:38.506169 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:38.506216 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:38.509151 (+ 2935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.509966 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.509972 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.509974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.510147 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.510452 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.510455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.510457 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.510829 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:38.511073 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:38.511316 (+ 243us) server_negotiation.cc:299] Negotiation successful
0805 23:00:38.511508 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
W20260805 23:00:38.512401 27144 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:51906
I20260805 23:00:38.514205 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27231
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970838, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:38.532037 27815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:38.515426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52152 (local address 127.22.45.65:36167)
0805 23:00:38.516075 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:38.516083 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:38.516109 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:00:38.516171 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:38.516177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:38.516397 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:38.516551 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:38.517774 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.519000 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.520731 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.521462 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.521773 (+ 311us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:38.526451 (+ 4678us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:38.526469 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:38.526486 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:38.526535 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:38.529333 (+ 2798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.530078 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.530085 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.530088 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.530228 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.530524 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.530528 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.530530 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.530949 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:38.531208 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:38.531429 (+ 221us) server_negotiation.cc:299] Negotiation successful
0805 23:00:38.531666 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":326,"threads_started":1}
W20260805 23:00:38.533362 27406 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:52152
W20260805 23:00:38.534498 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27231: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:38.534731 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 27231
I20260805 23:00:38.553115 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27421
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970838, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:38.571681 27816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:38.554141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33908 (local address 127.22.45.66:32933)
0805 23:00:38.554735 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:38.554743 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:38.554771 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:00:38.554850 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:38.554857 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:38.555141 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:38.555305 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:38.556656 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.557788 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.559296 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.559954 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.560076 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:38.564998 (+ 4922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:38.565018 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:38.565036 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:38.565105 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:38.568485 (+ 3380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.569423 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.569432 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.569435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.569617 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.570000 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.570005 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.570007 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.570430 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:38.570709 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:38.571088 (+ 379us) server_negotiation.cc:299] Negotiation successful
0805 23:00:38.571350 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":276,"threads_started":1}
W20260805 23:00:38.573276 27599 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:33908
W20260805 23:00:38.574543 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27421: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:38.574704 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 27421
I20260805 23:00:38.595274 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27617
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27083](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970838, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:38.613030 27817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:38.596367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34892 (local address 127.22.45.67:37163)
0805 23:00:38.597043 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:38.597053 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:38.597085 (+ 32us) server_negotiation.cc:407] Connection header received
0805 23:00:38.597149 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:38.597156 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:38.597405 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:38.597563 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:38.598875 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.600070 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.601367 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:38.601988 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:38.602142 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:38.607264 (+ 5122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:38.607282 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:38.607300 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:38.607343 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:38.610289 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.611153 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.611160 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.611162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.611294 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:38.611592 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:38.611595 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:38.611597 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:38.611961 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:38.612208 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:38.612434 (+ 226us) server_negotiation.cc:299] Negotiation successful
0805 23:00:38.612652 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":320,"threads_started":1}
W20260805 23:00:38.614357 27791 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34892
W20260805 23:00:38.615520 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27617: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:00:38.615680 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 27617
I20260805 23:00:38.635632 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27098
I20260805 23:00:38.637048 27190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:38.745270 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 27098
2026-08-05T23:00:38Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3992 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27822](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27822](info): set up 2 sockets
Aug 05 23:00:38 dist-test-slave-1vmg krb5kdc[27822](info): commencing operation
krb5kdc: starting...
W20260805 23:00:39.965456 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.171s user 0.005s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:40 dist-test-slave-1vmg krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:40.195088 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46229
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:46229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:40.560674 27838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:40.561055 27838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:40.561154 27838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:40.568861 27838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:40.569012 27838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:40.569062 27838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:40.569123 27838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:40.569167 27838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:40.579977 27838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:46229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:40.581481 27838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:40.582998 27838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:40.596056 27844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:40.596035 27846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:40.596115 27849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:40.597075 27838 server_base.cc:1034] running on GCE node
I20260805 23:00:40.598001 27838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:40.599720 27838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:40.600987 27838 hybrid_clock.cc:648] HybridClock initialized: now 1785970840600933 us; error 55 us; skew 500 ppm
I20260805 23:00:40.601398 27838 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:40 dist-test-slave-1vmg krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970840, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:40.608624 27838 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:40.610466 27838 webserver.cc:460] Webserver started at http://127.22.45.126:38815/ using document root <none> and password file <none>
I20260805 23:00:40.611322 27838 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:40.611449 27838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:40.611765 27838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:40.615175 27838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "1c413d2bf2aa4a06862579a9e52955b7"
format_stamp: "Formatted at 2026-08-05 23:00:40 on dist-test-slave-1vmg"
server_key: "cc7b32d176b64d2f30a79e3beabb0823"
server_key_iv: "50c07ca4fe8c270da287353f45fa4239"
server_key_version: "encryptionkey@0"
I20260805 23:00:40.616068 27838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "1c413d2bf2aa4a06862579a9e52955b7"
format_stamp: "Formatted at 2026-08-05 23:00:40 on dist-test-slave-1vmg"
server_key: "cc7b32d176b64d2f30a79e3beabb0823"
server_key_iv: "50c07ca4fe8c270da287353f45fa4239"
server_key_version: "encryptionkey@0"
I20260805 23:00:40.621965 27838 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:40.626142 27860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:40.627794 27838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:40.627980 27838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "1c413d2bf2aa4a06862579a9e52955b7"
format_stamp: "Formatted at 2026-08-05 23:00:40 on dist-test-slave-1vmg"
server_key: "cc7b32d176b64d2f30a79e3beabb0823"
server_key_iv: "50c07ca4fe8c270da287353f45fa4239"
server_key_version: "encryptionkey@0"
I20260805 23:00:40.628203 27838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:40.653537 27838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:40.658258 27838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:40.658587 27838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:40.678402 27838 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:46229
I20260805 23:00:40.678442 27933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:46229 every 8 connection(s)
I20260805 23:00:40.680024 27838 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:40.684373 27934 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:40.690510 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 27838
I20260805 23:00:40.690785 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:40.691659 22709 external_mini_cluster.cc:1428] Setting key e65118fb5c9c67051a8db411c0912209
I20260805 23:00:40.697784 27934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7: Bootstrap starting.
I20260805 23:00:40.702112 27934 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:40.703662 27934 log.cc:824] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:40.707967 27934 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7: No bootstrap required, opened a new log
Aug 05 23:00:40 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970840, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:40.716573 27934 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c413d2bf2aa4a06862579a9e52955b7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46229 } }
I20260805 23:00:40.717072 27934 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:40.717201 27934 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c413d2bf2aa4a06862579a9e52955b7, State: Initialized, Role: FOLLOWER
I20260805 23:00:40.717821 27934 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c413d2bf2aa4a06862579a9e52955b7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46229 } }
I20260805 23:00:40.718086 27934 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:40.718223 27934 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:40.718389 27934 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:40.718467 27940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:40.694117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41894 (local address 127.22.45.126:46229)
0805 23:00:40.695181 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:40.695196 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:40.695252 (+ 56us) server_negotiation.cc:407] Connection header received
0805 23:00:40.697281 (+ 2029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:40.697309 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:40.697820 (+ 511us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:40.698271 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:40.700420 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:40.701852 (+ 1432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:40.703785 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:40.704895 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:40.705168 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:40.710102 (+ 4934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:40.710112 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:40.710131 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:40.710181 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:40.713661 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:40.714497 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:40.714506 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:40.714514 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:40.714748 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:40.715199 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:40.715204 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:40.715207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:40.715865 (+ 658us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:40.716184 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:40.716687 (+ 503us) server_negotiation.cc:299] Negotiation successful
0805 23:00:40.717190 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":783,"thread_start_us":478,"threads_started":1}
I20260805 23:00:40.721324 27934 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c413d2bf2aa4a06862579a9e52955b7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46229 } }
I20260805 23:00:40.721902 27934 leader_election.cc:302] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c413d2bf2aa4a06862579a9e52955b7; no voters:
I20260805 23:00:40.722426 27934 leader_election.cc:288] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:40.722558 27942 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:40.723258 27942 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [term 1 LEADER]: Becoming Leader. State: Replica: 1c413d2bf2aa4a06862579a9e52955b7, State: Running, Role: LEADER
I20260805 23:00:40.723871 27942 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c413d2bf2aa4a06862579a9e52955b7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46229 } }
I20260805 23:00:40.724522 27934 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:40.727154 27943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c413d2bf2aa4a06862579a9e52955b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c413d2bf2aa4a06862579a9e52955b7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46229 } } }
I20260805 23:00:40.727581 27943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:40.727450 27945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c413d2bf2aa4a06862579a9e52955b7. Latest consensus state: current_term: 1 leader_uuid: "1c413d2bf2aa4a06862579a9e52955b7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c413d2bf2aa4a06862579a9e52955b7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46229 } } }
I20260805 23:00:40.727804 27945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:40.730347 27956 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:40.736784 27956 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:40.748607 27956 catalog_manager.cc:1347] Generated new cluster ID: fe12c93948484b3399c74227842cc251
I20260805 23:00:40.748762 27956 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:40.790726 27956 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:40.792742 27956 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:40.803023 27956 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c413d2bf2aa4a06862579a9e52955b7: Generated new TSK 0
I20260805 23:00:40.804260 27956 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:40.864257 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46229
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:41.224431 27972 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:41.224815 27972 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:41.224960 27972 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:41.233229 27972 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:41.233400 27972 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:41.233556 27972 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:41.244315 27972 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:41.245770 27972 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:41.247231 27972 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:41.261824 27981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:41.261847 27982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:41.261803 27985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:41.262558 27972 server_base.cc:1034] running on GCE node
I20260805 23:00:41.263329 27972 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:41.264536 27972 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:41.265770 27972 hybrid_clock.cc:648] HybridClock initialized: now 1785970841265713 us; error 68 us; skew 500 ppm
I20260805 23:00:41.266126 27972 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:41 dist-test-slave-1vmg krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:41.269621 27972 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:41.271346 27972 webserver.cc:460] Webserver started at http://127.22.45.65:38837/ using document root <none> and password file <none>
I20260805 23:00:41.272092 27972 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:41.272212 27972 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:41.272513 27972 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:41.275923 27972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "d1f365f78b8d45e89ed376560d2315f1"
format_stamp: "Formatted at 2026-08-05 23:00:41 on dist-test-slave-1vmg"
server_key: "11d977369fbe921a79da977215aa7a21"
server_key_iv: "8b3b995e287370e4590359d8600c42c1"
server_key_version: "encryptionkey@0"
I20260805 23:00:41.276768 27972 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "d1f365f78b8d45e89ed376560d2315f1"
format_stamp: "Formatted at 2026-08-05 23:00:41 on dist-test-slave-1vmg"
server_key: "11d977369fbe921a79da977215aa7a21"
server_key_iv: "8b3b995e287370e4590359d8600c42c1"
server_key_version: "encryptionkey@0"
I20260805 23:00:41.282678 27972 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:41.286720 27993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:41.288228 27972 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:41.288389 27972 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "d1f365f78b8d45e89ed376560d2315f1"
format_stamp: "Formatted at 2026-08-05 23:00:41 on dist-test-slave-1vmg"
server_key: "11d977369fbe921a79da977215aa7a21"
server_key_iv: "8b3b995e287370e4590359d8600c42c1"
server_key_version: "encryptionkey@0"
I20260805 23:00:41.288589 27972 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:41.300176 27972 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:41.305122 27972 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:41.305401 27972 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:41.306423 27972 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:41.307993 27972 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:41.308073 27972 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:41.308173 27972 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:41.308219 27972 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:41.345477 27972 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:40373
I20260805 23:00:41.345516 28150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:40373 every 8 connection(s)
I20260805 23:00:41.346853 27972 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:41.349553 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 27972
I20260805 23:00:41.349813 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:41.350467 22709 external_mini_cluster.cc:1428] Setting key 3bf35d1cb594b83053f0bd583f80500b
Aug 05 23:00:41 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:41.372596 28154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:41.349626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:39037 (local address 127.22.45.126:46229)
0805 23:00:41.350160 (+ 534us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:41.350166 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:41.351257 (+ 1091us) server_negotiation.cc:407] Connection header received
0805 23:00:41.353644 (+ 2387us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:41.353648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:41.353721 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:41.353816 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:41.356167 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.356967 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.359515 (+ 2548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.359993 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.360128 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:41.364507 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:41.364516 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:41.364520 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:41.364570 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:41.368063 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:41.369327 (+ 1264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:41.369334 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:41.369338 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:41.369523 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:41.370319 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:41.370325 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:41.370329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:41.370775 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:41.370995 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:41.371890 (+ 895us) server_negotiation.cc:299] Negotiation successful
0805 23:00:41.372197 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":243,"threads_started":1}
I20260805 23:00:41.373411 28155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:41.350175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46229 (local address 127.22.45.65:39037)
0805 23:00:41.351067 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:41.351135 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:41.353280 (+ 2145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:41.354116 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:41.354129 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:41.355023 (+ 894us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:41.355924 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:41.355951 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.357172 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.357177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:41.359281 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:41.359301 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.360269 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.360277 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:41.360596 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:41.361410 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:41.361438 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:41.364142 (+ 2704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:41.368321 (+ 4179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:41.368331 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:41.368349 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:41.369104 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:41.369720 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:41.369725 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:41.369727 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:41.370125 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:41.370993 (+ 868us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:41.371002 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:41.371418 (+ 416us) client_negotiation.cc:769] Sending connection context
0805 23:00:41.371701 (+ 283us) client_negotiation.cc:240] Negotiation successful
0805 23:00:41.372185 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":322,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:00:41.375396 28151 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46229
I20260805 23:00:41.375747 28151 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:41.376628 28151 heartbeater.cc:511] Master 127.22.45.126:46229 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
I20260805 23:00:41.379155 27885 ts_manager.cc:194] Registered new tserver with Master: d1f365f78b8d45e89ed376560d2315f1 (127.22.45.65:40373)
I20260805 23:00:41.380940 27885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:39037
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:41.404731 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46229
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:41.747594 28158 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:41.747962 28158 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:41.748065 28158 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:41.755753 28158 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:41.755903 28158 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:41.756027 28158 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:41.767079 28158 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:41.768745 28158 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:41.770349 28158 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:41.786346 28166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:41.786314 28167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:41.786950 28169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:41.787351 28158 server_base.cc:1034] running on GCE node
I20260805 23:00:41.788285 28158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:41.789690 28158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:41.790961 28158 hybrid_clock.cc:648] HybridClock initialized: now 1785970841790861 us; error 67 us; skew 500 ppm
I20260805 23:00:41.791360 28158 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:41 dist-test-slave-1vmg krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:41.795274 28158 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:41.796968 28158 webserver.cc:460] Webserver started at http://127.22.45.66:44961/ using document root <none> and password file <none>
I20260805 23:00:41.797755 28158 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:41.797890 28158 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:41.798228 28158 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:41.801640 28158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "d6be730dd4fa46f78e9f44d43a2a98bc"
format_stamp: "Formatted at 2026-08-05 23:00:41 on dist-test-slave-1vmg"
server_key: "8fb25664e574638ea123d2936fba594e"
server_key_iv: "8a7b8460a2a1bd2067f7e875d451ffd2"
server_key_version: "encryptionkey@0"
I20260805 23:00:41.802579 28158 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "d6be730dd4fa46f78e9f44d43a2a98bc"
format_stamp: "Formatted at 2026-08-05 23:00:41 on dist-test-slave-1vmg"
server_key: "8fb25664e574638ea123d2936fba594e"
server_key_iv: "8a7b8460a2a1bd2067f7e875d451ffd2"
server_key_version: "encryptionkey@0"
I20260805 23:00:41.808995 28158 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260805 23:00:41.813515 28182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:41.815212 28158 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:00:41.815418 28158 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "d6be730dd4fa46f78e9f44d43a2a98bc"
format_stamp: "Formatted at 2026-08-05 23:00:41 on dist-test-slave-1vmg"
server_key: "8fb25664e574638ea123d2936fba594e"
server_key_iv: "8a7b8460a2a1bd2067f7e875d451ffd2"
server_key_version: "encryptionkey@0"
I20260805 23:00:41.815652 28158 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:41.837241 28158 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:41.841853 28158 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:41.842159 28158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:41.843243 28158 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:41.844702 28158 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:41.844787 28158 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:41.844923 28158 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:41.844988 28158 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:41.880323 28158 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:33693
I20260805 23:00:41.880362 28328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:33693 every 8 connection(s)
I20260805 23:00:41.881723 28158 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:41.888828 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 28158
I20260805 23:00:41.889014 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:41.889436 22709 external_mini_cluster.cc:1428] Setting key a5987c4ecf5e49a48b09f8b945907364
Aug 05 23:00:41 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:41.906105 28331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:41.884616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:53099 (local address 127.22.45.126:46229)
0805 23:00:41.885099 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:41.885104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:41.886072 (+ 968us) server_negotiation.cc:407] Connection header received
0805 23:00:41.888190 (+ 2118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:41.888197 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:41.888292 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:41.888407 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:41.890417 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.891520 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.894054 (+ 2534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.894495 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.894619 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:41.899352 (+ 4733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:41.899358 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:41.899361 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:41.899401 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:41.902218 (+ 2817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:41.903228 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:41.903233 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:41.903235 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:41.903403 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:41.903928 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:41.903932 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:41.903934 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:41.904269 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:41.904444 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:41.905344 (+ 900us) server_negotiation.cc:299] Negotiation successful
0805 23:00:41.905639 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":248,"threads_started":1}
I20260805 23:00:41.907405 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:41.885074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46229 (local address 127.22.45.66:53099)
0805 23:00:41.885869 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:41.885914 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:41.887853 (+ 1939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:41.888730 (+ 877us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:41.888740 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:41.889416 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:41.890191 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:41.890222 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.891710 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.891714 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:41.893821 (+ 2107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:41.893844 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:41.894783 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:41.894791 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:41.895154 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:41.896019 (+ 865us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:41.896066 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:41.899042 (+ 2976us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:41.902427 (+ 3385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:41.902435 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:41.902451 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:41.903057 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:41.903539 (+ 482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:41.903544 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:41.903546 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:41.903780 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:41.904420 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:41.904430 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:41.904875 (+ 445us) client_negotiation.cc:769] Sending connection context
0805 23:00:41.905185 (+ 310us) client_negotiation.cc:240] Negotiation successful
0805 23:00:41.905834 (+ 649us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":303,"threads_started":1}
I20260805 23:00:41.909072 28329 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46229
I20260805 23:00:41.909473 28329 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:41.910483 28329 heartbeater.cc:511] Master 127.22.45.126:46229 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:00:41.912334 27885 ts_manager.cc:194] Registered new tserver with Master: d6be730dd4fa46f78e9f44d43a2a98bc (127.22.45.66:33693)
I20260805 23:00:41.913282 27885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:53099
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:41.940656 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46229
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:37727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:42.297994 28340 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:42.298360 28340 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:42.298465 28340 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:42.306371 28340 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:42.306541 28340 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:42.306664 28340 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:42.317431 28340 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:42.319001 28340 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:42.320622 28340 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:42.336239 28353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:42.336239 28350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:42.336416 28351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:42.341152 28340 server_base.cc:1034] running on GCE node
I20260805 23:00:42.341931 28340 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:42.343221 28340 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:42.344485 28340 hybrid_clock.cc:648] HybridClock initialized: now 1785970842344416 us; error 63 us; skew 500 ppm
I20260805 23:00:42.344844 28340 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:42 dist-test-slave-1vmg krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970842, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:42.348728 28340 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:42.350715 28340 webserver.cc:460] Webserver started at http://127.22.45.67:45169/ using document root <none> and password file <none>
I20260805 23:00:42.351573 28340 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:42.351718 28340 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:42.352054 28340 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:42.355845 28340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "38f53774f7924015869e53248714e773"
format_stamp: "Formatted at 2026-08-05 23:00:42 on dist-test-slave-1vmg"
server_key: "6f5dca15599a961d5098dc45e67a12ae"
server_key_iv: "322656fb3503d21745990d7359e6d84f"
server_key_version: "encryptionkey@0"
I20260805 23:00:42.356760 28340 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "38f53774f7924015869e53248714e773"
format_stamp: "Formatted at 2026-08-05 23:00:42 on dist-test-slave-1vmg"
server_key: "6f5dca15599a961d5098dc45e67a12ae"
server_key_iv: "322656fb3503d21745990d7359e6d84f"
server_key_version: "encryptionkey@0"
I20260805 23:00:42.363490 28340 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 23:00:42.368134 28365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:42.370106 28340 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:00:42.370357 28340 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "38f53774f7924015869e53248714e773"
format_stamp: "Formatted at 2026-08-05 23:00:42 on dist-test-slave-1vmg"
server_key: "6f5dca15599a961d5098dc45e67a12ae"
server_key_iv: "322656fb3503d21745990d7359e6d84f"
server_key_version: "encryptionkey@0"
I20260805 23:00:42.370608 28340 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:42.384605 28151 heartbeater.cc:503] Master 127.22.45.126:46229 was elected leader, sending a full tablet report...
I20260805 23:00:42.396993 28340 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:42.402690 28340 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:42.403105 28340 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:42.404281 28340 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:42.405823 28340 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:42.405910 28340 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:42.406001 28340 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:42.406046 28340 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:42.441548 28340 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:43547
I20260805 23:00:42.441474 28509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:43547 every 8 connection(s)
I20260805 23:00:42.443579 28340 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:42.447319 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 28340
I20260805 23:00:42.447500 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:42.447945 22709 external_mini_cluster.cc:1428] Setting key 4577e03f73b0bc377ab2f66fcc503884
Aug 05 23:00:42 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970842, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:42.470160 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:42.448940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:44285 (local address 127.22.45.126:46229)
0805 23:00:42.449439 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:42.449444 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:42.451459 (+ 2015us) server_negotiation.cc:407] Connection header received
0805 23:00:42.453551 (+ 2092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:42.453555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:42.453627 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:42.453716 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:42.455400 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.456216 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.457991 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.458407 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.458516 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:42.462228 (+ 3712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:42.462234 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:42.462237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:42.462276 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:42.466468 (+ 4192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.467448 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.467453 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.467455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.467599 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.468085 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.468090 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.468092 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.468406 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:42.468566 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:42.469437 (+ 871us) server_negotiation.cc:299] Negotiation successful
0805 23:00:42.469744 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":263,"threads_started":1}
I20260805 23:00:42.471355 28516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:42.449569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46229 (local address 127.22.45.67:44285)
0805 23:00:42.451284 (+ 1715us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:42.451346 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:42.453282 (+ 1936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:42.453933 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:42.453943 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:42.454540 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:42.455235 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:42.455257 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.456369 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.456374 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:42.457834 (+ 1460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:42.457848 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.458595 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.458600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:42.458805 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:42.459527 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:42.459552 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:42.461952 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:42.466653 (+ 4701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:42.466663 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:42.466682 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:42.467294 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:42.467717 (+ 423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:42.467721 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:42.467723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:42.467951 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:42.468551 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:42.468561 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:42.468997 (+ 436us) client_negotiation.cc:769] Sending connection context
0805 23:00:42.469287 (+ 290us) client_negotiation.cc:240] Negotiation successful
0805 23:00:42.469907 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":595,"spinlock_wait_cycles":25472,"thread_start_us":498,"threads_started":1}
I20260805 23:00:42.473323 28510 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46229
I20260805 23:00:42.473945 28510 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:42.475297 28510 heartbeater.cc:511] Master 127.22.45.126:46229 requested a full tablet report, sending...
I20260805 23:00:42.477499 27885 ts_manager.cc:194] Registered new tserver with Master: 38f53774f7924015869e53248714e773 (127.22.45.67:43547)
I20260805 23:00:42.479219 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:00:42.479211 27885 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:44285
Aug 05 23:00:42 dist-test-slave-1vmg krb5kdc[27822](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 23:00:42 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:42.541514 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:42.522749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58994 (local address 127.22.45.65:40373)
0805 23:00:42.523433 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:42.523441 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:42.523471 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:00:42.523536 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:42.523544 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:42.523791 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:42.523931 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:42.525636 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.526739 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.528192 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.528838 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.528982 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:42.533686 (+ 4704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:42.533705 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:42.533721 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:42.533773 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:42.537245 (+ 3472us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.538099 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.538109 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.538111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.538293 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.538884 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.538892 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.538895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.539696 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:42.540432 (+ 736us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:42.540818 (+ 386us) server_negotiation.cc:299] Negotiation successful
0805 23:00:42.541097 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":338,"threads_started":1}
Aug 05 23:00:42 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:42.562494 28515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:42.546860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41898 (local address 127.22.45.126:46229)
0805 23:00:42.547151 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:42.547158 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:42.547291 (+ 133us) server_negotiation.cc:407] Connection header received
0805 23:00:42.547481 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:42.547485 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:42.547557 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:42.547650 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:42.549129 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.549927 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.551396 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.551842 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.551970 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:42.556500 (+ 4530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:42.556506 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:42.556510 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:42.556639 (+ 129us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:42.559522 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.560383 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.560388 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.560390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.560543 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.560985 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.560989 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.560992 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.561407 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:42.561633 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:42.562013 (+ 380us) server_negotiation.cc:299] Negotiation successful
0805 23:00:42.562255 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
W20260805 23:00:42.563225 27885 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41898
I20260805 23:00:42.564343 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27972
I20260805 23:00:42.578467 28522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:42.565438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58998 (local address 127.22.45.65:40373)
0805 23:00:42.565648 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:42.565653 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:42.565748 (+ 95us) server_negotiation.cc:407] Connection header received
0805 23:00:42.565881 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:42.565885 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:42.565950 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:42.566029 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:42.567380 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.568132 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.569408 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.569884 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.570002 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:42.572614 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:42.572620 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:42.572624 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:42.572669 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:42.575463 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.576366 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.576371 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.576373 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.576573 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.577093 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.577098 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.577100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.577435 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:42.577635 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:42.577935 (+ 300us) server_negotiation.cc:299] Negotiation successful
0805 23:00:42.578136 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:00:42.579144 28145 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:42.664405 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 27972
I20260805 23:00:42.690841 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 28158
Aug 05 23:00:42 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:42.708091 28529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:42.691927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37490 (local address 127.22.45.66:33693)
0805 23:00:42.692470 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:42.692478 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:42.692505 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:00:42.692566 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:42.692573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:42.692815 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:42.692965 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:42.694277 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.695408 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.696676 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.697284 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.697391 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:42.701915 (+ 4524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:42.701934 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:42.701952 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:42.701999 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:42.705173 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.705981 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.705988 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.705990 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.706130 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.706482 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.706486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.706488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.706883 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:42.707199 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:42.707466 (+ 267us) server_negotiation.cc:299] Negotiation successful
0805 23:00:42.707695 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":285,"threads_started":1}
I20260805 23:00:42.709462 28322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:42.794202 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 28158
I20260805 23:00:42.816978 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 28340
Aug 05 23:00:42 dist-test-slave-1vmg krb5kdc[27822](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970842, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:42.836012 28532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:42.818095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53078 (local address 127.22.45.67:43547)
0805 23:00:42.818800 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:42.818808 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:42.818841 (+ 33us) server_negotiation.cc:407] Connection header received
0805 23:00:42.818906 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:42.818936 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:42.819189 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:42.819382 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:42.820863 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.822131 (+ 1268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.823664 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:42.824297 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:42.824426 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:42.829401 (+ 4975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:42.829421 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:42.829439 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:42.829485 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:42.832690 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.833579 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.833587 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.833589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.833741 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:42.834133 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:42.834136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:42.834138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:42.834541 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:42.834864 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:42.835344 (+ 480us) server_negotiation.cc:299] Negotiation successful
0805 23:00:42.835634 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":358,"threads_started":1}
I20260805 23:00:42.837399 28502 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:42.921092 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 28340
I20260805 23:00:42.942142 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 27838
I20260805 23:00:42.943487 27929 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:43.050288 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 27838
2026-08-05T23:00:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4304 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:43 dist-test-slave-1vmg krb5kdc[28540](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:43 dist-test-slave-1vmg krb5kdc[28540](info): set up 2 sockets
Aug 05 23:00:43 dist-test-slave-1vmg krb5kdc[28540](info): commencing operation
krb5kdc: starting...
W20260805 23:00:44.250468 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:44 dist-test-slave-1vmg krb5kdc[28540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:44.494969 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46071
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:46071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:44.853197 28556 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:44.853543 28556 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:44.853642 28556 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:44.862112 28556 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:44.862285 28556 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:44.862339 28556 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:44.862401 28556 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:44.862450 28556 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:44.873695 28556 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:46071
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:44.875283 28556 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:44.876778 28556 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:44.890858 28562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:44.890774 28563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:44.890803 28566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:44.891826 28556 server_base.cc:1034] running on GCE node
I20260805 23:00:44.892797 28556 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:44.894450 28556 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:44.895695 28556 hybrid_clock.cc:648] HybridClock initialized: now 1785970844895648 us; error 52 us; skew 500 ppm
I20260805 23:00:44.896116 28556 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:44 dist-test-slave-1vmg krb5kdc[28540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970844, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:44.899893 28556 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:44.901311 28556 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:44.901436 28556 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:44.901818 28556 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:44.905258 28556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "c13963a424da46a69b0f45abee74943d"
format_stamp: "Formatted at 2026-08-05 23:00:44 on dist-test-slave-1vmg"
server_key: "1936edefc4be2872707358e2bc615101"
server_key_iv: "431b3c0b90c06a13e662b9bc59b775ec"
server_key_version: "encryptionkey@0"
I20260805 23:00:44.906203 28556 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "c13963a424da46a69b0f45abee74943d"
format_stamp: "Formatted at 2026-08-05 23:00:44 on dist-test-slave-1vmg"
server_key: "1936edefc4be2872707358e2bc615101"
server_key_iv: "431b3c0b90c06a13e662b9bc59b775ec"
server_key_version: "encryptionkey@0"
I20260805 23:00:44.912282 28556 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260805 23:00:44.917701 28572 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:44.920240 28556 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260805 23:00:44.920488 28556 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "c13963a424da46a69b0f45abee74943d"
format_stamp: "Formatted at 2026-08-05 23:00:44 on dist-test-slave-1vmg"
server_key: "1936edefc4be2872707358e2bc615101"
server_key_iv: "431b3c0b90c06a13e662b9bc59b775ec"
server_key_version: "encryptionkey@0"
I20260805 23:00:44.920770 28556 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:44.941326 28556 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:44.946316 28556 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:44.946614 28556 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:44.969713 28556 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:46071
I20260805 23:00:44.969703 28642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:46071 every 8 connection(s)
I20260805 23:00:44.970865 28556 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:44.971448 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 28556
I20260805 23:00:44.971680 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:44.972568 22709 external_mini_cluster.cc:1428] Setting key 331cc7c5ee9402585a5972c8964b7b2b
I20260805 23:00:44.975764 28644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:00:44 dist-test-slave-1vmg krb5kdc[28540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:44.991067 28644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d: Bootstrap starting.
I20260805 23:00:44.995620 28644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:44.997048 28644 log.cc:824] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:44.999953 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:44.974974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54494 (local address 127.22.45.126:46071)
0805 23:00:44.975848 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:44.975862 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:44.975909 (+ 47us) server_negotiation.cc:407] Connection header received
0805 23:00:44.977813 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:44.977839 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:44.978260 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:44.978633 (+ 373us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:44.980681 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:44.982221 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:44.984295 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:44.985065 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:44.985244 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:44.990572 (+ 5328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:44.990587 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:44.990623 (+ 36us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:44.990689 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:44.994892 (+ 4203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:44.995856 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:44.995866 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:44.995876 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:44.996163 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:44.996650 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:44.996654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:44.996658 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:44.997475 (+ 817us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:44.997860 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:44.998310 (+ 450us) server_negotiation.cc:299] Negotiation successful
0805 23:00:44.998799 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":401,"threads_started":1}
I20260805 23:00:45.000612 28644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d: No bootstrap required, opened a new log
I20260805 23:00:45.009439 28644 raft_consensus.cc:348] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13963a424da46a69b0f45abee74943d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46071 } }
I20260805 23:00:45.009939 28644 raft_consensus.cc:374] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:45.010040 28644 raft_consensus.cc:729] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c13963a424da46a69b0f45abee74943d, State: Initialized, Role: FOLLOWER
I20260805 23:00:45.010695 28644 consensus_queue.cc:260] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13963a424da46a69b0f45abee74943d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46071 } }
I20260805 23:00:45.011014 28644 raft_consensus.cc:388] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:45.011165 28644 raft_consensus.cc:482] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:45.011335 28644 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:45.014117 28644 raft_consensus.cc:504] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13963a424da46a69b0f45abee74943d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46071 } }
I20260805 23:00:45.014799 28644 leader_election.cc:302] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c13963a424da46a69b0f45abee74943d; no voters:
I20260805 23:00:45.015586 28644 leader_election.cc:288] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:45.016525 28649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:45.017772 28649 raft_consensus.cc:686] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [term 1 LEADER]: Becoming Leader. State: Replica: c13963a424da46a69b0f45abee74943d, State: Running, Role: LEADER
I20260805 23:00:45.019186 28649 consensus_queue.cc:237] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13963a424da46a69b0f45abee74943d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46071 } }
I20260805 23:00:45.019979 28644 sys_catalog.cc:564] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:45.025166 28651 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c13963a424da46a69b0f45abee74943d. Latest consensus state: current_term: 1 leader_uuid: "c13963a424da46a69b0f45abee74943d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13963a424da46a69b0f45abee74943d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46071 } } }
I20260805 23:00:45.025717 28651 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:45.025170 28650 sys_catalog.cc:455] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c13963a424da46a69b0f45abee74943d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c13963a424da46a69b0f45abee74943d" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46071 } } }
I20260805 23:00:45.026633 28650 sys_catalog.cc:458] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:45.028595 28660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:45.035179 28660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:45.047467 28660 catalog_manager.cc:1347] Generated new cluster ID: c524c0a04e454552912e9f22de32172c
I20260805 23:00:45.047672 28660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:45.066745 28660 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:45.068378 28660 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:45.080108 28660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d: Generated new TSK 0
I20260805 23:00:45.081188 28660 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:45.144698 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46071
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:45.503602 28678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:45.503937 28678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:45.504063 28678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:45.511821 28678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:45.511962 28678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:45.512120 28678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:45.522404 28678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:45.523874 28678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:45.525275 28678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:45.538815 28686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:45.538969 28689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:45.538826 28687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:45.539414 28678 server_base.cc:1034] running on GCE node
I20260805 23:00:45.540201 28678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:45.541185 28678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:45.542392 28678 hybrid_clock.cc:648] HybridClock initialized: now 1785970845542339 us; error 49 us; skew 500 ppm
I20260805 23:00:45.542722 28678 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:45 dist-test-slave-1vmg krb5kdc[28540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970845, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:45.545941 28678 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:45.547243 28678 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:45.547374 28678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:45.547678 28678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:45.551021 28678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "0677711b10114293b5c4fdf0416fcb31"
format_stamp: "Formatted at 2026-08-05 23:00:45 on dist-test-slave-1vmg"
server_key: "356e1244933f5e11e7930f8ff92f1a2b"
server_key_iv: "d97af2aeeb81aa33b41fc81b7152d9d4"
server_key_version: "encryptionkey@0"
I20260805 23:00:45.551981 28678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "0677711b10114293b5c4fdf0416fcb31"
format_stamp: "Formatted at 2026-08-05 23:00:45 on dist-test-slave-1vmg"
server_key: "356e1244933f5e11e7930f8ff92f1a2b"
server_key_iv: "d97af2aeeb81aa33b41fc81b7152d9d4"
server_key_version: "encryptionkey@0"
I20260805 23:00:45.558027 28678 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:45.562296 28698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:45.564042 28678 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:45.564244 28678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "0677711b10114293b5c4fdf0416fcb31"
format_stamp: "Formatted at 2026-08-05 23:00:45 on dist-test-slave-1vmg"
server_key: "356e1244933f5e11e7930f8ff92f1a2b"
server_key_iv: "d97af2aeeb81aa33b41fc81b7152d9d4"
server_key_version: "encryptionkey@0"
I20260805 23:00:45.564468 28678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:45.586479 28678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:45.591356 28678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:45.591665 28678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:45.593014 28678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:45.594561 28678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:45.594668 28678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:45.594764 28678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:45.594820 28678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:45.629227 28678 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:44559
I20260805 23:00:45.629307 28850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:44559 every 8 connection(s)
I20260805 23:00:45.630159 28678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:45.639668 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 28678
I20260805 23:00:45.639896 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:45.640508 22709 external_mini_cluster.cc:1428] Setting key 1f44386eb915743bcdb925a5d3053001
Aug 05 23:00:45 dist-test-slave-1vmg krb5kdc[28540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970845, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:45.655277 28853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:45.632689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:37339 (local address 127.22.45.126:46071)
0805 23:00:45.633129 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:45.633134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:45.634043 (+ 909us) server_negotiation.cc:407] Connection header received
0805 23:00:45.636011 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:45.636017 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:45.636108 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:45.636217 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:45.638034 (+ 1817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:45.638770 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:45.640535 (+ 1765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:45.641015 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:45.641147 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:45.648802 (+ 7655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:45.648808 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:45.648811 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:45.648855 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:45.651688 (+ 2833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:45.652651 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:45.652656 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:45.652659 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:45.652806 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:45.653291 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:45.653295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:45.653297 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:45.653614 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:45.653767 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:45.654593 (+ 826us) server_negotiation.cc:299] Negotiation successful
0805 23:00:45.654861 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":214,"threads_started":1}
I20260805 23:00:45.656396 28854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:45.633145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46071 (local address 127.22.45.65:37339)
0805 23:00:45.633868 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:45.633916 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:45.635717 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:45.636461 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:45.636470 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:45.637063 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:45.637825 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:45.637845 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:45.638982 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:45.638986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:45.640376 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:45.640390 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:45.641252 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:45.641257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:45.641537 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:45.645454 (+ 3917us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:45.645495 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:45.648454 (+ 2959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:45.651906 (+ 3452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:45.651916 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:45.651934 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:45.652487 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:45.652930 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:45.652935 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:45.652938 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:45.653158 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:45.653767 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:45.653777 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:45.654171 (+ 394us) client_negotiation.cc:769] Sending connection context
0805 23:00:45.654438 (+ 267us) client_negotiation.cc:240] Negotiation successful
0805 23:00:45.655108 (+ 670us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":282,"threads_started":1}
I20260805 23:00:45.658332 28851 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46071
I20260805 23:00:45.658738 28851 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:45.659782 28851 heartbeater.cc:511] Master 127.22.45.126:46071 requested a full tablet report, sending...
I20260805 23:00:45.662846 28593 ts_manager.cc:194] Registered new tserver with Master: 0677711b10114293b5c4fdf0416fcb31 (127.22.45.65:44559)
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:00:45.664868 28593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:37339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:45.695129 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46071
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:46.059398 28858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:46.059751 28858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:46.059859 28858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:46.067343 28858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:46.067484 28858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:46.067618 28858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:46.077697 28858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:46.079136 28858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:46.080688 28858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:46.093990 28869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:46.094058 28864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:46.094029 28865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:46.095181 28858 server_base.cc:1034] running on GCE node
I20260805 23:00:46.095957 28858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:46.097016 28858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:46.098271 28858 hybrid_clock.cc:648] HybridClock initialized: now 1785970846098196 us; error 57 us; skew 500 ppm
I20260805 23:00:46.098615 28858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:46 dist-test-slave-1vmg krb5kdc[28540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970846, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:46.102118 28858 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:46.103515 28858 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:46.103644 28858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:46.103988 28858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:46.107340 28858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "ca0a7e934c2a49cd9c68ec40567b9848"
format_stamp: "Formatted at 2026-08-05 23:00:46 on dist-test-slave-1vmg"
server_key: "8496b2c98b7dc0af055ae748edc0dc39"
server_key_iv: "d70e40d12fafb4346785c089c6aeca43"
server_key_version: "encryptionkey@0"
I20260805 23:00:46.108253 28858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "ca0a7e934c2a49cd9c68ec40567b9848"
format_stamp: "Formatted at 2026-08-05 23:00:46 on dist-test-slave-1vmg"
server_key: "8496b2c98b7dc0af055ae748edc0dc39"
server_key_iv: "d70e40d12fafb4346785c089c6aeca43"
server_key_version: "encryptionkey@0"
I20260805 23:00:46.113719 28858 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260805 23:00:46.117636 28880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:46.119176 28858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 23:00:46.119366 28858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "ca0a7e934c2a49cd9c68ec40567b9848"
format_stamp: "Formatted at 2026-08-05 23:00:46 on dist-test-slave-1vmg"
server_key: "8496b2c98b7dc0af055ae748edc0dc39"
server_key_iv: "d70e40d12fafb4346785c089c6aeca43"
server_key_version: "encryptionkey@0"
I20260805 23:00:46.119604 28858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:46.134847 28858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:46.140317 28858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:46.140628 28858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:46.141888 28858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:46.143743 28858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:46.143855 28858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:46.143950 28858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:46.144034 28858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:46.176647 28858 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:40253
I20260805 23:00:46.176699 29018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:40253 every 8 connection(s)
I20260805 23:00:46.177541 28858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:46.181473 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 28858
I20260805 23:00:46.181682 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:46.182219 22709 external_mini_cluster.cc:1428] Setting key aebc98e3a157ea852f70cd62c7eaf613
Aug 05 23:00:46 dist-test-slave-1vmg krb5kdc[28540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970846, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:46.199620 29022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.180163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:56783 (local address 127.22.45.126:46071)
0805 23:00:46.180622 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.180627 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.181634 (+ 1007us) server_negotiation.cc:407] Connection header received
0805 23:00:46.183972 (+ 2338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.183977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.184045 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.184164 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:46.186019 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.186770 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.188531 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.188997 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.189120 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.193134 (+ 4014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:46.193140 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:46.193143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:46.193183 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:46.195898 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:46.196989 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:46.196993 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:46.196996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:46.197144 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:46.197607 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:46.197611 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:46.197613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:46.197929 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:46.198071 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.198889 (+ 818us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.199210 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":227,"threads_started":1}
I20260805 23:00:46.200867 29023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.180733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46071 (local address 127.22.45.66:56783)
0805 23:00:46.181465 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:46.181505 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:46.183646 (+ 2141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:46.184496 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:46.184511 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:46.185111 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:46.185815 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.185838 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.186988 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.186992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.188351 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.188366 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.189275 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.189284 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.189507 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.190268 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:46.190299 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:46.192825 (+ 2526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:46.196082 (+ 3257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:46.196093 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:46.196116 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:46.196836 (+ 720us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:46.197269 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:46.197274 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:46.197278 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:46.197485 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:46.198064 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:46.198073 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:46.198496 (+ 423us) client_negotiation.cc:769] Sending connection context
0805 23:00:46.198767 (+ 271us) client_negotiation.cc:240] Negotiation successful
0805 23:00:46.199401 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":295,"threads_started":1}
I20260805 23:00:46.202548 29020 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46071
I20260805 23:00:46.202874 29020 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:00:46.203608 29020 heartbeater.cc:511] Master 127.22.45.126:46071 requested a full tablet report, sending...
I20260805 23:00:46.205179 28593 ts_manager.cc:194] Registered new tserver with Master: ca0a7e934c2a49cd9c68ec40567b9848 (127.22.45.66:40253)
I20260805 23:00:46.206116 28593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:56783
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:46.233650 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46071
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:46.588558 29027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:46.588900 29027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:46.589003 29027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:46.596726 29027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:46.596899 29027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:46.597059 29027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:46.607756 29027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:46.609217 29027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:46.610623 29027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:46.624934 29034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:46.625022 29036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:46.624913 29038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:46.625785 29027 server_base.cc:1034] running on GCE node
I20260805 23:00:46.626613 29027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:46.627851 29027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:46.629123 29027 hybrid_clock.cc:648] HybridClock initialized: now 1785970846629058 us; error 56 us; skew 500 ppm
I20260805 23:00:46.629496 29027 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:46 dist-test-slave-1vmg krb5kdc[28540](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970846, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:46.633250 29027 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:46.634600 29027 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:46.634732 29027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:46.635144 29027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:46.638479 29027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "8d708420b2b2495a9f9a6915adc35a20"
format_stamp: "Formatted at 2026-08-05 23:00:46 on dist-test-slave-1vmg"
server_key: "7e096c7c6c10edee21cbd5b76f7757ee"
server_key_iv: "34608b780db355447b1d173de9dc5793"
server_key_version: "encryptionkey@0"
I20260805 23:00:46.639520 29027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "8d708420b2b2495a9f9a6915adc35a20"
format_stamp: "Formatted at 2026-08-05 23:00:46 on dist-test-slave-1vmg"
server_key: "7e096c7c6c10edee21cbd5b76f7757ee"
server_key_iv: "34608b780db355447b1d173de9dc5793"
server_key_version: "encryptionkey@0"
I20260805 23:00:46.645721 29027 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260805 23:00:46.650035 29047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:46.651911 29027 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260805 23:00:46.652158 29027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "8d708420b2b2495a9f9a6915adc35a20"
format_stamp: "Formatted at 2026-08-05 23:00:46 on dist-test-slave-1vmg"
server_key: "7e096c7c6c10edee21cbd5b76f7757ee"
server_key_iv: "34608b780db355447b1d173de9dc5793"
server_key_version: "encryptionkey@0"
I20260805 23:00:46.652415 29027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:46.668736 28851 heartbeater.cc:503] Master 127.22.45.126:46071 was elected leader, sending a full tablet report...
I20260805 23:00:46.675740 29027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:46.680560 29027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:46.680832 29027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:46.681895 29027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:46.683514 29027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:46.683622 29027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:46.683715 29027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:46.683770 29027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:46.717531 29027 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:39637
I20260805 23:00:46.717582 29193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:39637 every 8 connection(s)
I20260805 23:00:46.718513 29027 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:46.728420 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 29027
I20260805 23:00:46.728643 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:46.729221 22709 external_mini_cluster.cc:1428] Setting key 54234656463ac7c40be1ff9d455d7dc4
Aug 05 23:00:46 dist-test-slave-1vmg krb5kdc[28540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970846, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:46.740803 29197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.721193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:49247 (local address 127.22.45.126:46071)
0805 23:00:46.721816 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.721823 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.722767 (+ 944us) server_negotiation.cc:407] Connection header received
0805 23:00:46.724707 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.724712 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.724793 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.724904 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:46.726659 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.727547 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.729922 (+ 2375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.730464 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.730615 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.734581 (+ 3966us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:46.734588 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:46.734592 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:46.734632 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:46.737503 (+ 2871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:46.738370 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:46.738375 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:46.738377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:46.738548 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:46.739066 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:46.739070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:46.739072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:46.739380 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:46.739511 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.740304 (+ 793us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.740502 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":469,"thread_start_us":267,"threads_started":1}
I20260805 23:00:46.741878 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.721830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46071 (local address 127.22.45.67:49247)
0805 23:00:46.722588 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:46.722635 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:46.724436 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:46.725104 (+ 668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:46.725113 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:46.725745 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:46.726433 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.726452 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.727711 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.727715 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.729708 (+ 1993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.729726 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.730744 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.730753 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.731074 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.731852 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:46.731879 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:46.734317 (+ 2438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:46.737691 (+ 3374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:46.737699 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:46.737719 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:46.738228 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:46.738688 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:46.738691 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:46.738694 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:46.738905 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:46.739505 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:46.739518 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:46.739909 (+ 391us) client_negotiation.cc:769] Sending connection context
0805 23:00:46.740169 (+ 260us) client_negotiation.cc:240] Negotiation successful
0805 23:00:46.740646 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":311,"threads_started":1}
I20260805 23:00:46.743794 29194 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46071
I20260805 23:00:46.744231 29194 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:46.745128 29194 heartbeater.cc:511] Master 127.22.45.126:46071 requested a full tablet report, sending...
I20260805 23:00:46.746817 28593 ts_manager.cc:194] Registered new tserver with Master: 8d708420b2b2495a9f9a6915adc35a20 (127.22.45.67:39637)
I20260805 23:00:46.747735 28593 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:49247
I20260805 23:00:46.758296 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:00:46.779348 29197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.763346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54504 (local address 127.22.45.126:46071)
0805 23:00:46.763549 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.763554 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.764166 (+ 612us) server_negotiation.cc:407] Connection header received
0805 23:00:46.764301 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.764305 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.764384 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.764480 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:46.766098 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.766863 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.768714 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.769241 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.769376 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.772806 (+ 3430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:46.772813 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:46.772817 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:46.772868 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:46.776165 (+ 3297us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:46.777070 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:46.777074 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:46.777077 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:46.777241 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:46.777711 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:46.777715 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:46.777718 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:46.778119 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:46.778326 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.778798 (+ 472us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.779090 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:00:46.784698 28593 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54504:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:46.794308 28593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:46.834864 29215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.810381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44559 (local address 127.0.0.1:54602)
0805 23:00:46.823861 (+ 13480us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:46.823986 (+ 125us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:46.824275 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:46.826232 (+ 1957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:46.826238 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:46.826272 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:46.827179 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.827200 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.829761 (+ 2561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.829767 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.831600 (+ 1833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.831622 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.833683 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.833691 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.833925 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.834003 (+ 78us) client_negotiation.cc:769] Sending connection context
0805 23:00:46.834173 (+ 170us) client_negotiation.cc:240] Negotiation successful
0805 23:00:46.834392 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13294,"mutex_wait_us":60,"thread_start_us":13819,"threads_started":1}
I20260805 23:00:46.835176 29214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.810597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52698 (local address 127.22.45.67:39637)
0805 23:00:46.823881 (+ 13284us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.823895 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.825321 (+ 1426us) server_negotiation.cc:407] Connection header received
0805 23:00:46.825440 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.825447 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.825694 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.825977 (+ 283us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:46.827536 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.828776 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.831906 (+ 3130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.833485 (+ 1579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.833635 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.833890 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.834580 (+ 690us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.834777 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12933,"thread_start_us":14297,"threads_started":1}
I20260805 23:00:46.835211 29211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.809748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:39637 (local address 127.0.0.1:52698)
0805 23:00:46.810537 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:46.810587 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:46.810797 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:46.826318 (+ 15521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:46.826323 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:46.826345 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:46.827179 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.827200 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.829003 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.829008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.831650 (+ 2642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.831672 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.834063 (+ 2391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.834069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.834308 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.834386 (+ 78us) client_negotiation.cc:769] Sending connection context
0805 23:00:46.834479 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 23:00:46.834637 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"mutex_wait_us":121,"thread_start_us":743,"threads_started":1}
I20260805 23:00:46.835577 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.815038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35376 (local address 127.22.45.66:40253)
0805 23:00:46.821484 (+ 6446us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.821498 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.824764 (+ 3266us) server_negotiation.cc:407] Connection header received
0805 23:00:46.825043 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.825053 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.825463 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.825806 (+ 343us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:46.826758 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.828378 (+ 1620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.831912 (+ 3534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.833490 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.833635 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.833834 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.834594 (+ 760us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.834789 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6183,"thread_start_us":5977,"threads_started":1}
I20260805 23:00:46.835983 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.810254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54602 (local address 127.22.45.65:44559)
0805 23:00:46.825037 (+ 14783us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.825047 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.825084 (+ 37us) server_negotiation.cc:407] Connection header received
0805 23:00:46.825483 (+ 399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.825493 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.825860 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.826232 (+ 372us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:46.827406 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.829514 (+ 2108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.831810 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.833042 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.833230 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.833526 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.835488 (+ 1962us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.835666 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14534,"thread_start_us":14971,"threads_started":1}
I20260805 23:00:46.836392 29213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.814164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:40253 (local address 127.0.0.1:35376)
0805 23:00:46.824549 (+ 10385us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:46.824582 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:46.824806 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:46.825820 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:46.825828 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:46.825866 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:46.826474 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.826497 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.828573 (+ 2076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.828580 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.831650 (+ 3070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.831670 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.834046 (+ 2376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.834054 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.834303 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.834387 (+ 84us) client_negotiation.cc:769] Sending connection context
0805 23:00:46.834479 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 23:00:46.836028 (+ 1549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10234,"mutex_wait_us":1498,"thread_start_us":9235,"threads_started":1}
I20260805 23:00:46.839749 28939 tablet_service.cc:1467] Processing CreateTablet for tablet b186eee53d4341bda396b206574f36c5 (DEFAULT_TABLE table=test-table [id=aa56087f727f4c0b821a7f1f7043fe90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:46.839775 28764 tablet_service.cc:1467] Processing CreateTablet for tablet b186eee53d4341bda396b206574f36c5 (DEFAULT_TABLE table=test-table [id=aa56087f727f4c0b821a7f1f7043fe90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:46.839775 29111 tablet_service.cc:1467] Processing CreateTablet for tablet b186eee53d4341bda396b206574f36c5 (DEFAULT_TABLE table=test-table [id=aa56087f727f4c0b821a7f1f7043fe90]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:46.841311 29111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b186eee53d4341bda396b206574f36c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:46.841315 28764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b186eee53d4341bda396b206574f36c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:46.841315 28939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b186eee53d4341bda396b206574f36c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:46.856495 29219 tablet_bootstrap.cc:492] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Bootstrap starting.
I20260805 23:00:46.860049 29219 tablet_bootstrap.cc:654] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:46.861295 29219 log.cc:824] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:46.862936 29222 tablet_bootstrap.cc:492] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Bootstrap starting.
I20260805 23:00:46.863904 29220 tablet_bootstrap.cc:492] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Bootstrap starting.
I20260805 23:00:46.865432 29219 tablet_bootstrap.cc:492] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: No bootstrap required, opened a new log
I20260805 23:00:46.865793 29219 ts_tablet_manager.cc:1397] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.007s
I20260805 23:00:46.868300 29220 tablet_bootstrap.cc:654] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:46.869829 29220 log.cc:824] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:46.870428 29222 tablet_bootstrap.cc:654] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:46.871920 29222 log.cc:824] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:46.873855 29220 tablet_bootstrap.cc:492] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: No bootstrap required, opened a new log
I20260805 23:00:46.874203 29220 ts_tablet_manager.cc:1397] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260805 23:00:46.875221 29222 tablet_bootstrap.cc:492] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: No bootstrap required, opened a new log
I20260805 23:00:46.875612 29222 ts_tablet_manager.cc:1397] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.003s
I20260805 23:00:46.876698 29219 raft_consensus.cc:348] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:46.877240 29219 raft_consensus.cc:374] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:46.877400 29219 raft_consensus.cc:729] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca0a7e934c2a49cd9c68ec40567b9848, State: Initialized, Role: FOLLOWER
I20260805 23:00:46.878142 29219 consensus_queue.cc:260] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:46.879489 29020 heartbeater.cc:503] Master 127.22.45.126:46071 was elected leader, sending a full tablet report...
I20260805 23:00:46.881955 29219 ts_tablet_manager.cc:1428] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Time spent starting tablet: real 0.016s user 0.013s sys 0.002s
I20260805 23:00:46.884575 29220 raft_consensus.cc:348] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:46.885126 29220 raft_consensus.cc:374] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:46.885238 29220 raft_consensus.cc:729] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0677711b10114293b5c4fdf0416fcb31, State: Initialized, Role: FOLLOWER
I20260805 23:00:46.885423 29222 raft_consensus.cc:348] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:46.885836 29222 raft_consensus.cc:374] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:46.885939 29222 raft_consensus.cc:729] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d708420b2b2495a9f9a6915adc35a20, State: Initialized, Role: FOLLOWER
I20260805 23:00:46.885926 29220 consensus_queue.cc:260] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:46.886494 29222 consensus_queue.cc:260] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:46.888155 29194 heartbeater.cc:503] Master 127.22.45.126:46071 was elected leader, sending a full tablet report...
I20260805 23:00:46.888697 29220 ts_tablet_manager.cc:1428] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Time spent starting tablet: real 0.014s user 0.005s sys 0.011s
I20260805 23:00:46.888805 29222 ts_tablet_manager.cc:1428] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
W20260805 23:00:46.929617 29021 tablet.cc:2369] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:00:46.970117 29196 tablet.cc:2369] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:00:46.986425 29230 raft_consensus.cc:482] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:46.986758 29230 raft_consensus.cc:504] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:46.988583 29230 leader_election.cc:288] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d708420b2b2495a9f9a6915adc35a20 (127.22.45.67:39637), ca0a7e934c2a49cd9c68ec40567b9848 (127.22.45.66:40253)
I20260805 23:00:46.995510 29214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.989114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:55251 (local address 127.22.45.67:39637)
0805 23:00:46.989345 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.989351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.990003 (+ 652us) server_negotiation.cc:407] Connection header received
0805 23:00:46.990239 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.990243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.990308 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.990388 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:46.991014 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.991760 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.993664 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.994496 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.994664 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.994751 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.995112 (+ 361us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.995263 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:00:46.995675 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.989125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:48823 (local address 127.22.45.66:40253)
0805 23:00:46.989325 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:46.989331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:46.990397 (+ 1066us) server_negotiation.cc:407] Connection header received
0805 23:00:46.990576 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:46.990581 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:46.990651 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:46.990730 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:00:46.991340 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.992059 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.993885 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.994695 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.994846 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.994951 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:46.995257 (+ 306us) server_negotiation.cc:299] Negotiation successful
0805 23:00:46.995398 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:00:46.995735 29233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.989075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:39637 (local address 127.22.45.65:55251)
0805 23:00:46.989870 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:46.989892 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:46.990071 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:46.990491 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:46.990496 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:46.990523 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:46.990843 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.990853 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.991903 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.991909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.993492 (+ 1583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.993507 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.994734 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.994740 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.994907 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.994973 (+ 66us) client_negotiation.cc:769] Sending connection context
0805 23:00:46.995066 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 23:00:46.995217 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":679,"mutex_wait_us":24,"thread_start_us":433,"threads_started":1}
I20260805 23:00:46.995786 29234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:46.989412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:40253 (local address 127.22.45.65:48823)
0805 23:00:46.990287 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:46.990302 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:46.990419 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:46.990781 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:46.990786 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:46.990815 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:00:46.991169 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.991178 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.992231 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.992234 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.993704 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:46.993718 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:46.994964 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:46.994971 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:46.995098 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:46.995121 (+ 23us) client_negotiation.cc:769] Sending connection context
0805 23:00:46.995211 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 23:00:46.995345 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"mutex_wait_us":27,"thread_start_us":545,"threads_started":1}
I20260805 23:00:46.996999 29136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b186eee53d4341bda396b206574f36c5" candidate_uuid: "0677711b10114293b5c4fdf0416fcb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d708420b2b2495a9f9a6915adc35a20" is_pre_election: true
I20260805 23:00:46.997044 28963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b186eee53d4341bda396b206574f36c5" candidate_uuid: "0677711b10114293b5c4fdf0416fcb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" is_pre_election: true
I20260805 23:00:46.997663 29136 raft_consensus.cc:2454] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0677711b10114293b5c4fdf0416fcb31 in term 0.
I20260805 23:00:46.997655 28963 raft_consensus.cc:2454] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0677711b10114293b5c4fdf0416fcb31 in term 0.
I20260805 23:00:46.998448 28701 leader_election.cc:302] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0677711b10114293b5c4fdf0416fcb31, 8d708420b2b2495a9f9a6915adc35a20; no voters:
I20260805 23:00:46.998895 29230 raft_consensus.cc:2781] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:46.999110 29230 raft_consensus.cc:482] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:46.999228 29230 raft_consensus.cc:3037] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:47.001657 29230 raft_consensus.cc:504] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:47.002386 29230 leader_election.cc:288] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [CANDIDATE]: Term 1 election: Requested vote from peers 8d708420b2b2495a9f9a6915adc35a20 (127.22.45.67:39637), ca0a7e934c2a49cd9c68ec40567b9848 (127.22.45.66:40253)
I20260805 23:00:47.003114 29136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b186eee53d4341bda396b206574f36c5" candidate_uuid: "0677711b10114293b5c4fdf0416fcb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d708420b2b2495a9f9a6915adc35a20"
I20260805 23:00:47.003126 28963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b186eee53d4341bda396b206574f36c5" candidate_uuid: "0677711b10114293b5c4fdf0416fcb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca0a7e934c2a49cd9c68ec40567b9848"
I20260805 23:00:47.003358 29136 raft_consensus.cc:3037] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:47.003369 28963 raft_consensus.cc:3037] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:47.005730 29136 raft_consensus.cc:2454] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0677711b10114293b5c4fdf0416fcb31 in term 1.
I20260805 23:00:47.005735 28963 raft_consensus.cc:2454] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0677711b10114293b5c4fdf0416fcb31 in term 1.
I20260805 23:00:47.006255 28701 leader_election.cc:302] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0677711b10114293b5c4fdf0416fcb31, 8d708420b2b2495a9f9a6915adc35a20; no voters:
I20260805 23:00:47.006582 29230 raft_consensus.cc:2781] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:47.007104 29230 raft_consensus.cc:686] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 1 LEADER]: Becoming Leader. State: Replica: 0677711b10114293b5c4fdf0416fcb31, State: Running, Role: LEADER
I20260805 23:00:47.007711 29230 consensus_queue.cc:237] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } }
I20260805 23:00:47.012853 28593 catalog_manager.cc:5495] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0677711b10114293b5c4fdf0416fcb31 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "0677711b10114293b5c4fdf0416fcb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0677711b10114293b5c4fdf0416fcb31" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 } health_report { overall_health: UNKNOWN } } }
I20260805 23:00:47.033141 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:47.027322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54610 (local address 127.22.45.65:44559)
0805 23:00:47.027561 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:47.027568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:47.027631 (+ 63us) server_negotiation.cc:407] Connection header received
0805 23:00:47.027845 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:47.027849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:47.027948 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:47.028096 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:00:47.028520 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.029302 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.030715 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.031235 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.031345 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:47.031940 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:00:47.032525 (+ 585us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:00:47.032647 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:47.032779 (+ 132us) server_negotiation.cc:299] Negotiation successful
0805 23:00:47.032862 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 23:00:47.042201 29136 raft_consensus.cc:1261] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 1 FOLLOWER]: Refusing update from remote peer 0677711b10114293b5c4fdf0416fcb31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:47.042200 28963 raft_consensus.cc:1261] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 1 FOLLOWER]: Refusing update from remote peer 0677711b10114293b5c4fdf0416fcb31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:47.043284 29230 consensus_queue.cc:1035] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca0a7e934c2a49cd9c68ec40567b9848" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 40253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:47.043659 29235 consensus_queue.cc:1035] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d708420b2b2495a9f9a6915adc35a20" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:47.055373 29238 mvcc.cc:205] Tried to move back new op lower bound from 7315336589474254848 to 7315336589347606528. Current Snapshot: MvccSnapshot[applied={T|T < 7315336589474254848}]
I20260805 23:00:47.073282 28593 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:47.073632 28593 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54504:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:47.078133 28593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c13963a424da46a69b0f45abee74943d: Sending DeleteTablet for 3 replicas of tablet b186eee53d4341bda396b206574f36c5
I20260805 23:00:47.079645 28764 tablet_service.cc:1514] Processing DeleteTablet for tablet b186eee53d4341bda396b206574f36c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:47 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:54602
I20260805 23:00:47.079758 29111 tablet_service.cc:1514] Processing DeleteTablet for tablet b186eee53d4341bda396b206574f36c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:47 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:52698
I20260805 23:00:47.079978 28939 tablet_service.cc:1514] Processing DeleteTablet for tablet b186eee53d4341bda396b206574f36c5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:47 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:35376
I20260805 23:00:47.081471 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 28678
I20260805 23:00:47.081529 29249 tablet_replica.cc:330] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: stopping tablet replica
I20260805 23:00:47.082022 29249 raft_consensus.cc:2229] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:47.082866 29249 raft_consensus.cc:2258] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:47.088354 29249 ts_tablet_manager.cc:1905] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:47.093187 29251 tablet_replica.cc:330] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: stopping tablet replica
I20260805 23:00:47.097819 29249 ts_tablet_manager.cc:1918] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:47.098083 29251 raft_consensus.cc:2229] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:47.098184 29249 log.cc:1196] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/b186eee53d4341bda396b206574f36c5
I20260805 23:00:47.098830 29249 ts_tablet_manager.cc:1939] T b186eee53d4341bda396b206574f36c5 P 0677711b10114293b5c4fdf0416fcb31: Deleting consensus metadata
I20260805 23:00:47.098973 29250 tablet_replica.cc:330] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: stopping tablet replica
I20260805 23:00:47.099628 29251 raft_consensus.cc:2258] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:47.100267 29250 raft_consensus.cc:2229] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:47.101013 29250 raft_consensus.cc:2258] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:47.101140 28573 catalog_manager.cc:4841] TS 0677711b10114293b5c4fdf0416fcb31 (127.22.45.65:44559): tablet b186eee53d4341bda396b206574f36c5 (table test-table [id=aa56087f727f4c0b821a7f1f7043fe90]) successfully deleted
I20260805 23:00:47.103914 29251 ts_tablet_manager.cc:1905] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:47.103914 29250 ts_tablet_manager.cc:1905] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 05 23:00:47 dist-test-slave-1vmg krb5kdc[28540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:47.112272 29250 ts_tablet_manager.cc:1918] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:47.112272 29251 ts_tablet_manager.cc:1918] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:47.112488 29251 log.cc:1196] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/b186eee53d4341bda396b206574f36c5
I20260805 23:00:47.112699 29250 log.cc:1196] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/b186eee53d4341bda396b206574f36c5
I20260805 23:00:47.113155 29251 ts_tablet_manager.cc:1939] T b186eee53d4341bda396b206574f36c5 P ca0a7e934c2a49cd9c68ec40567b9848: Deleting consensus metadata
I20260805 23:00:47.113298 29250 ts_tablet_manager.cc:1939] T b186eee53d4341bda396b206574f36c5 P 8d708420b2b2495a9f9a6915adc35a20: Deleting consensus metadata
I20260805 23:00:47.115340 28575 catalog_manager.cc:4841] TS 8d708420b2b2495a9f9a6915adc35a20 (127.22.45.67:39637): tablet b186eee53d4341bda396b206574f36c5 (table test-table [id=aa56087f727f4c0b821a7f1f7043fe90]) successfully deleted
I20260805 23:00:47.115484 28577 catalog_manager.cc:4841] TS ca0a7e934c2a49cd9c68ec40567b9848 (127.22.45.66:40253): tablet b186eee53d4341bda396b206574f36c5 (table test-table [id=aa56087f727f4c0b821a7f1f7043fe90]) successfully deleted
I20260805 23:00:47.116111 29212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:47.083213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54624 (local address 127.22.45.65:44559)
0805 23:00:47.083425 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:47.083432 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:47.092820 (+ 9388us) server_negotiation.cc:407] Connection header received
0805 23:00:47.093312 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:47.093321 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:47.093458 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:47.093539 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:47.095814 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.097281 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.099368 (+ 2087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.100163 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.100289 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:47.106469 (+ 6180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:47.106496 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:47.106518 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:47.106589 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:47.111739 (+ 5150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:47.112967 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:47.112980 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:47.112984 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:47.113218 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:47.113758 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:47.113764 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:47.113767 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:47.114312 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:47.114635 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:47.115350 (+ 715us) server_negotiation.cc:299] Negotiation successful
0805 23:00:47.115685 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 23:00:47.117033 28840 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:47.218608 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 28678
I20260805 23:00:47.240506 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 28858
Aug 05 23:00:47 dist-test-slave-1vmg krb5kdc[28540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:47.257046 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:47.241333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35388 (local address 127.22.45.66:40253)
0805 23:00:47.241540 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:47.241547 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:47.241573 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:00:47.241731 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:47.241735 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:47.241802 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:47.241902 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:47.243249 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.243999 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.245278 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.245676 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.245797 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:47.250286 (+ 4489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:47.250305 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:47.250322 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:47.250364 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:47.253516 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:47.254438 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:47.254447 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:47.254450 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:47.254610 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:47.255200 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:47.255204 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:47.255207 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:47.255719 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:47.256034 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:47.256453 (+ 419us) server_negotiation.cc:299] Negotiation successful
0805 23:00:47.256710 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 23:00:47.257815 29013 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:47.352246 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 28858
I20260805 23:00:47.376036 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 29027
Aug 05 23:00:47 dist-test-slave-1vmg krb5kdc[28540](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970844, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:47.392609 29214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:47.376854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52706 (local address 127.22.45.67:39637)
0805 23:00:47.377052 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:47.377057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:47.377076 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:00:47.377190 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:47.377209 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:47.377279 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:47.377365 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:47.378701 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.379506 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.380939 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:47.381403 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:47.381509 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:47.386385 (+ 4876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:47.386405 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:47.386422 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:47.386469 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:47.389658 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:47.390526 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:47.390534 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:47.390537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:47.390704 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:47.391121 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:47.391125 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:47.391127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:47.391529 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:47.391765 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:47.392015 (+ 250us) server_negotiation.cc:299] Negotiation successful
0805 23:00:47.392247 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 23:00:47.393325 29189 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:47.487522 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 29027
I20260805 23:00:47.511533 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 28556
I20260805 23:00:47.512708 28638 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:47.624517 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 28556
2026-08-05T23:00:47Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4574 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-05T23:00:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:47Z Disabled control of system clock
I20260805 23:00:47.706825 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:32927
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:32927
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 23:00:48.069207 29264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:48.069572 29264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:48.069686 29264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:48.077461 29264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:48.077607 29264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:48.077646 29264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:48.077714 29264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:48.077785 29264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:48.087574 29264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:32927
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:32927
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:48.089005 29264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:48.090998 29264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:48.103380 29273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:48.103406 29270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:48.103504 29269 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:48.104154 29264 server_base.cc:1034] running on GCE node
I20260805 23:00:48.105093 29264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:48.106694 29264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:48.107946 29264 hybrid_clock.cc:648] HybridClock initialized: now 1785970848107886 us; error 56 us; skew 500 ppm
I20260805 23:00:48.108381 29264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:48.111167 29264 webserver.cc:460] Webserver started at http://127.22.45.126:44555/ using document root <none> and password file <none>
I20260805 23:00:48.112042 29264 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:48.112162 29264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:48.112537 29264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:48.115842 29264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "b3669852e8f744c5bb2f6bd473913a27"
format_stamp: "Formatted at 2026-08-05 23:00:48 on dist-test-slave-1vmg"
server_key: "b1fa165063b74bbacccf7409e924a6b1"
server_key_iv: "5e2ea472842cef8ad15ebfb698d6a5f1"
server_key_version: "encryptionkey@0"
I20260805 23:00:48.116731 29264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "b3669852e8f744c5bb2f6bd473913a27"
format_stamp: "Formatted at 2026-08-05 23:00:48 on dist-test-slave-1vmg"
server_key: "b1fa165063b74bbacccf7409e924a6b1"
server_key_iv: "5e2ea472842cef8ad15ebfb698d6a5f1"
server_key_version: "encryptionkey@0"
I20260805 23:00:48.122401 29264 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 23:00:48.126389 29279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:48.127988 29264 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:48.128199 29264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "b3669852e8f744c5bb2f6bd473913a27"
format_stamp: "Formatted at 2026-08-05 23:00:48 on dist-test-slave-1vmg"
server_key: "b1fa165063b74bbacccf7409e924a6b1"
server_key_iv: "5e2ea472842cef8ad15ebfb698d6a5f1"
server_key_version: "encryptionkey@0"
I20260805 23:00:48.128450 29264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:48.134754 29264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:48.135663 29264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:48.135967 29264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:48.154949 29264 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:32927
I20260805 23:00:48.154996 29350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:32927 every 8 connection(s)
I20260805 23:00:48.156466 29264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:48.161427 29351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:48.162823 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 29264
I20260805 23:00:48.163043 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:48.163689 22709 external_mini_cluster.cc:1428] Setting key 9bd03c7a499d6190e6e55e23c30e8c9b
I20260805 23:00:48.174371 29355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:48.165880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41204 (local address 127.22.45.126:32927)
0805 23:00:48.167163 (+ 1283us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:48.167179 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:48.167236 (+ 57us) server_negotiation.cc:407] Connection header received
0805 23:00:48.169571 (+ 2335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:48.169603 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:48.170193 (+ 590us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:48.170676 (+ 483us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:48.172021 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:48.172030 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:48.172053 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:48.172074 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:48.172161 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:48.172185 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:48.172483 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:48.172651 (+ 168us) server_negotiation.cc:299] Negotiation successful
0805 23:00:48.173014 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":388,"threads_started":1}
I20260805 23:00:48.175967 29351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27: Bootstrap starting.
I20260805 23:00:48.179905 29351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:48.180938 29351 log.cc:824] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:48.184222 29351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27: No bootstrap required, opened a new log
I20260805 23:00:48.192261 29351 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3669852e8f744c5bb2f6bd473913a27" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 32927 } }
I20260805 23:00:48.192840 29351 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:48.192950 29351 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3669852e8f744c5bb2f6bd473913a27, State: Initialized, Role: FOLLOWER
I20260805 23:00:48.193835 29351 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3669852e8f744c5bb2f6bd473913a27" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 32927 } }
I20260805 23:00:48.194084 29351 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:48.194216 29351 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:48.194361 29351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:48.196794 29351 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3669852e8f744c5bb2f6bd473913a27" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 32927 } }
I20260805 23:00:48.197402 29351 leader_election.cc:302] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3669852e8f744c5bb2f6bd473913a27; no voters:
I20260805 23:00:48.198277 29351 leader_election.cc:288] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:48.198396 29357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:48.199347 29357 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [term 1 LEADER]: Becoming Leader. State: Replica: b3669852e8f744c5bb2f6bd473913a27, State: Running, Role: LEADER
I20260805 23:00:48.200049 29357 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3669852e8f744c5bb2f6bd473913a27" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 32927 } }
I20260805 23:00:48.201155 29351 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:48.203483 29358 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3669852e8f744c5bb2f6bd473913a27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3669852e8f744c5bb2f6bd473913a27" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 32927 } } }
I20260805 23:00:48.203971 29358 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:48.204444 29359 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3669852e8f744c5bb2f6bd473913a27. Latest consensus state: current_term: 1 leader_uuid: "b3669852e8f744c5bb2f6bd473913a27" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3669852e8f744c5bb2f6bd473913a27" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 32927 } } }
I20260805 23:00:48.204819 29359 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:48.206822 29368 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:48.212661 29368 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:48.222517 29368 catalog_manager.cc:1347] Generated new cluster ID: 2bc73703216748ea84661ab61c1cf66e
I20260805 23:00:48.222664 29368 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:48.238438 29368 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:48.239136 29368 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:48.251071 29368 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27: Generated new TSK 0
I20260805 23:00:48.252418 29368 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:00:48.265084 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:32927
--builtin_ntp_servers=127.22.45.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260805 23:00:48.632025 29385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:48.632421 29385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:48.632565 29385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:48.640283 29385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:48.640419 29385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:48.640580 29385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:48.650666 29385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:32927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:48.652249 29385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:48.654294 29385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:48.669777 29392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:48.669709 29393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:48.669970 29395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:48.671487 29385 server_base.cc:1034] running on GCE node
I20260805 23:00:48.672564 29385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:48.674211 29385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:48.675483 29385 hybrid_clock.cc:648] HybridClock initialized: now 1785970848675414 us; error 76 us; skew 500 ppm
I20260805 23:00:48.675887 29385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:48.678767 29385 webserver.cc:460] Webserver started at http://127.22.45.65:35103/ using document root <none> and password file <none>
I20260805 23:00:48.679661 29385 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:48.679821 29385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:48.680188 29385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:48.683669 29385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "a17c86c2f8c94351af9a1855bb4e6b24"
format_stamp: "Formatted at 2026-08-05 23:00:48 on dist-test-slave-1vmg"
server_key: "1dd7c5b85086723f09892d7b9acea18c"
server_key_iv: "9fc9829f78f3acb233d3600bdcd084ed"
server_key_version: "encryptionkey@0"
I20260805 23:00:48.684669 29385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "a17c86c2f8c94351af9a1855bb4e6b24"
format_stamp: "Formatted at 2026-08-05 23:00:48 on dist-test-slave-1vmg"
server_key: "1dd7c5b85086723f09892d7b9acea18c"
server_key_iv: "9fc9829f78f3acb233d3600bdcd084ed"
server_key_version: "encryptionkey@0"
I20260805 23:00:48.690975 29385 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:00:48.695513 29401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:48.697337 29385 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:00:48.697552 29385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "a17c86c2f8c94351af9a1855bb4e6b24"
format_stamp: "Formatted at 2026-08-05 23:00:48 on dist-test-slave-1vmg"
server_key: "1dd7c5b85086723f09892d7b9acea18c"
server_key_iv: "9fc9829f78f3acb233d3600bdcd084ed"
server_key_version: "encryptionkey@0"
I20260805 23:00:48.697820 29385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:48.704758 29385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:48.705914 29385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:48.706215 29385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:48.707333 29385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:48.708997 29385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:48.709105 29385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:48.709223 29385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:48.709295 29385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:48.742302 29385 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:33095
I20260805 23:00:48.742317 29556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:33095 every 8 connection(s)
I20260805 23:00:48.743912 29385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:48.752779 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 29385
I20260805 23:00:48.752960 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:48.753646 22709 external_mini_cluster.cc:1428] Setting key 37fdef927aac581523a30751b0e48ba6
I20260805 23:00:48.753865 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:48.747165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:40419 (local address 127.22.45.126:32927)
0805 23:00:48.747662 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:48.747667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:48.749103 (+ 1436us) server_negotiation.cc:407] Connection header received
0805 23:00:48.751141 (+ 2038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:48.751147 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:48.751233 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:48.751368 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:48.753039 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:48.753045 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:48.753051 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:48.753085 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:48.753139 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:48.753153 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:48.753285 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:48.753486 (+ 201us) server_negotiation.cc:299] Negotiation successful
0805 23:00:48.753564 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":244,"threads_started":1}
I20260805 23:00:48.755268 29562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:48.747834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:32927 (local address 127.22.45.65:40419)
0805 23:00:48.748892 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:48.748933 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:48.750682 (+ 1749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:48.751679 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:48.751690 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:48.751816 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:48.752586 (+ 770us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:48.752589 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:48.752635 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:48.752754 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:48.753257 (+ 503us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:48.753269 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:48.753278 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 23:00:48.753587 (+ 309us) client_negotiation.cc:240] Negotiation successful
0805 23:00:48.753924 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":334,"threads_started":1}
I20260805 23:00:48.757067 29557 heartbeater.cc:347] Connected to a master server at 127.22.45.126:32927
I20260805 23:00:48.757069 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:32927
--builtin_ntp_servers=127.22.45.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260805 23:00:48.757429 29557 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:48.758101 29557 heartbeater.cc:511] Master 127.22.45.126:32927 requested a full tablet report, sending...
I20260805 23:00:48.760802 29304 ts_manager.cc:194] Registered new tserver with Master: a17c86c2f8c94351af9a1855bb4e6b24 (127.22.45.65:33095)
W20260805 23:00:49.128782 29564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:49.129127 29564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:49.129257 29564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:49.137025 29564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:49.137162 29564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:49.137308 29564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:49.147094 29564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:32927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:49.148602 29564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:49.150606 29564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:49.168594 29573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:49.168766 29571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:49.168713 29575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:49.169615 29564 server_base.cc:1034] running on GCE node
I20260805 23:00:49.170284 29564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:49.171438 29564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:49.172704 29564 hybrid_clock.cc:648] HybridClock initialized: now 1785970849172636 us; error 68 us; skew 500 ppm
I20260805 23:00:49.173079 29564 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:49.175765 29564 webserver.cc:460] Webserver started at http://127.22.45.66:40099/ using document root <none> and password file <none>
I20260805 23:00:49.176566 29564 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:49.176697 29564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:49.177098 29564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:49.180501 29564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "baf735b6fdf7412ea290f675ce4b5da0"
format_stamp: "Formatted at 2026-08-05 23:00:49 on dist-test-slave-1vmg"
server_key: "ea42307ce9e5a8756ddcaf711d81485c"
server_key_iv: "2fb832155e00ae097cd75af97a418e88"
server_key_version: "encryptionkey@0"
I20260805 23:00:49.181478 29564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "baf735b6fdf7412ea290f675ce4b5da0"
format_stamp: "Formatted at 2026-08-05 23:00:49 on dist-test-slave-1vmg"
server_key: "ea42307ce9e5a8756ddcaf711d81485c"
server_key_iv: "2fb832155e00ae097cd75af97a418e88"
server_key_version: "encryptionkey@0"
I20260805 23:00:49.187407 29564 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 23:00:49.191419 29586 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:49.193038 29564 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:00:49.193230 29564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "baf735b6fdf7412ea290f675ce4b5da0"
format_stamp: "Formatted at 2026-08-05 23:00:49 on dist-test-slave-1vmg"
server_key: "ea42307ce9e5a8756ddcaf711d81485c"
server_key_iv: "2fb832155e00ae097cd75af97a418e88"
server_key_version: "encryptionkey@0"
I20260805 23:00:49.193473 29564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:49.200058 29564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:49.200922 29564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:49.201208 29564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:49.202229 29564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:49.203778 29564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:49.203868 29564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:49.203954 29564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:49.204008 29564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:49.239192 29564 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:35009
I20260805 23:00:49.239241 29736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:35009 every 8 connection(s)
I20260805 23:00:49.240543 29564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:49.244189 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 29564
I20260805 23:00:49.244357 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:49.244820 22709 external_mini_cluster.cc:1428] Setting key c0681a56c3cf825f47f6855b37ab6276
I20260805 23:00:49.248677 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:32927
--builtin_ntp_servers=127.22.45.84:37467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260805 23:00:49.250123 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.243241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:45359 (local address 127.22.45.126:32927)
0805 23:00:49.243433 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.243438 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.245114 (+ 1676us) server_negotiation.cc:407] Connection header received
0805 23:00:49.247259 (+ 2145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.247267 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.247381 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.247461 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.249340 (+ 1879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.249345 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.249348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.249369 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.249411 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.249423 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.249556 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.249757 (+ 201us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.249836 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:00:49.251394 29740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.243798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:32927 (local address 127.22.45.66:45359)
0805 23:00:49.244905 (+ 1107us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:49.244953 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:49.246820 (+ 1867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:49.248013 (+ 1193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:49.248023 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:49.248138 (+ 115us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:49.248976 (+ 838us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:49.248979 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:49.249023 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:49.249128 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:49.249520 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:49.249539 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:49.249552 (+ 13us) client_negotiation.cc:769] Sending connection context
0805 23:00:49.249858 (+ 306us) client_negotiation.cc:240] Negotiation successful
0805 23:00:49.250182 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":348,"threads_started":1}
I20260805 23:00:49.253057 29738 heartbeater.cc:347] Connected to a master server at 127.22.45.126:32927
I20260805 23:00:49.253417 29738 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:49.254073 29738 heartbeater.cc:511] Master 127.22.45.126:32927 requested a full tablet report, sending...
I20260805 23:00:49.255808 29304 ts_manager.cc:194] Registered new tserver with Master: baf735b6fdf7412ea290f675ce4b5da0 (127.22.45.66:35009)
W20260805 23:00:49.618458 29742 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:49.618824 29742 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:49.618950 29742 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:49.627084 29742 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:49.627228 29742 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:49.627351 29742 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:49.637324 29742 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:37467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:32927
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:49.638794 29742 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:49.641037 29742 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:49.655900 29755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:49.655989 29758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:49.655946 29756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:49.657141 29742 server_base.cc:1034] running on GCE node
I20260805 23:00:49.657914 29742 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:49.659137 29742 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:49.660406 29742 hybrid_clock.cc:648] HybridClock initialized: now 1785970849660344 us; error 55 us; skew 500 ppm
I20260805 23:00:49.660790 29742 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:49.663583 29742 webserver.cc:460] Webserver started at http://127.22.45.67:38219/ using document root <none> and password file <none>
I20260805 23:00:49.664420 29742 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:49.664556 29742 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:49.664942 29742 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:49.668308 29742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "c8ee6f1324924f60a1ff23fdd2928b43"
format_stamp: "Formatted at 2026-08-05 23:00:49 on dist-test-slave-1vmg"
server_key: "8181141378ee776121c88aadef609e51"
server_key_iv: "ab6c92b680ca9e6a3948608661c68714"
server_key_version: "encryptionkey@0"
I20260805 23:00:49.669236 29742 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "c8ee6f1324924f60a1ff23fdd2928b43"
format_stamp: "Formatted at 2026-08-05 23:00:49 on dist-test-slave-1vmg"
server_key: "8181141378ee776121c88aadef609e51"
server_key_iv: "ab6c92b680ca9e6a3948608661c68714"
server_key_version: "encryptionkey@0"
I20260805 23:00:49.675525 29742 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:00:49.679528 29764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:49.681165 29742 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:00:49.681385 29742 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "c8ee6f1324924f60a1ff23fdd2928b43"
format_stamp: "Formatted at 2026-08-05 23:00:49 on dist-test-slave-1vmg"
server_key: "8181141378ee776121c88aadef609e51"
server_key_iv: "ab6c92b680ca9e6a3948608661c68714"
server_key_version: "encryptionkey@0"
I20260805 23:00:49.681650 29742 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:49.688299 29742 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:49.689347 29742 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:49.689674 29742 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:49.690789 29742 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:49.692549 29742 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:49.692673 29742 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:49.692781 29742 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:49.692845 29742 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:49.728470 29742 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:41323
I20260805 23:00:49.728515 29911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:41323 every 8 connection(s)
I20260805 23:00:49.730100 29742 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:49.733887 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 29742
I20260805 23:00:49.734035 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:49.734464 22709 external_mini_cluster.cc:1428] Setting key abab3e3952c45d4b0be2a087c54ab47b
I20260805 23:00:49.739882 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.733243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:33551 (local address 127.22.45.126:32927)
0805 23:00:49.733441 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.733447 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.735253 (+ 1806us) server_negotiation.cc:407] Connection header received
0805 23:00:49.737365 (+ 2112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.737370 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.737435 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.737540 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.739138 (+ 1598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.739143 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.739147 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.739167 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.739202 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.739222 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.739328 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.739566 (+ 238us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.739622 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260805 23:00:49.740998 29914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.733805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:32927 (local address 127.22.45.67:33551)
0805 23:00:49.735059 (+ 1254us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:49.735111 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:49.737010 (+ 1899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:49.737834 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:49.737844 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:49.737957 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:49.738758 (+ 801us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:49.738761 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:49.738806 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:49.738911 (+ 105us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:49.739355 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:49.739365 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:49.739373 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 23:00:49.739650 (+ 277us) client_negotiation.cc:240] Negotiation successful
0805 23:00:49.739919 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":381,"threads_started":1}
I20260805 23:00:49.742671 29912 heartbeater.cc:347] Connected to a master server at 127.22.45.126:32927
I20260805 23:00:49.743052 29912 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:49.743701 29912 heartbeater.cc:511] Master 127.22.45.126:32927 requested a full tablet report, sending...
I20260805 23:00:49.745416 29304 ts_manager.cc:194] Registered new tserver with Master: c8ee6f1324924f60a1ff23fdd2928b43 (127.22.45.67:41323)
I20260805 23:00:49.750401 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:00:49.758060 29560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.755258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41214 (local address 127.22.45.126:32927)
0805 23:00:49.755452 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.755457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.756009 (+ 552us) server_negotiation.cc:407] Connection header received
0805 23:00:49.756160 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.756165 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.756249 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.756346 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.757358 (+ 1012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.757363 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.757366 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.757384 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.757421 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.757433 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.757555 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.757757 (+ 202us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.757824 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:00:49.764935 29557 heartbeater.cc:503] Master 127.22.45.126:32927 was elected leader, sending a full tablet report...
I20260805 23:00:49.763156 29304 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41214:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:00:49.770661 29304 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:00:49.799150 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.786280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53630 (local address 127.22.45.67:41323)
0805 23:00:49.794230 (+ 7950us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.794242 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.794298 (+ 56us) server_negotiation.cc:407] Connection header received
0805 23:00:49.794403 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.794414 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.794761 (+ 347us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.796004 (+ 1243us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.797647 (+ 1643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.797657 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.797673 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.797693 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.797851 (+ 158us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.797878 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.798534 (+ 656us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.798616 (+ 82us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.798735 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7685,"thread_start_us":7468,"threads_started":1}
I20260805 23:00:49.799253 29931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.785205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59794 (local address 127.22.45.66:35009)
0805 23:00:49.795314 (+ 10109us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.795321 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.795356 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:00:49.795431 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.795439 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.795698 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.796466 (+ 768us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.797764 (+ 1298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.797774 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.797784 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.797844 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.797953 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.797979 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.798726 (+ 747us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.798802 (+ 76us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.798894 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9943,"thread_start_us":9028,"threads_started":1}
I20260805 23:00:49.799516 29932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.785638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:41323 (local address 127.0.0.1:53630)
0805 23:00:49.786661 (+ 1023us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:49.786682 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:49.786803 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:49.795111 (+ 8308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:49.795122 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:49.795265 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:49.796389 (+ 1124us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:49.796393 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:49.796432 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:49.796556 (+ 124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:49.798021 (+ 1465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:49.798045 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:49.798055 (+ 10us) client_negotiation.cc:769] Sending connection context
0805 23:00:49.798291 (+ 236us) client_negotiation.cc:240] Negotiation successful
0805 23:00:49.798407 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"mutex_wait_us":27,"thread_start_us":879,"threads_started":1}
I20260805 23:00:49.799577 29928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.784787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:35009 (local address 127.0.0.1:59794)
0805 23:00:49.785869 (+ 1082us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:49.785922 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:49.786077 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:49.796312 (+ 10235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:49.796319 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:49.796348 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:49.797108 (+ 760us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:49.797111 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:49.797131 (+ 20us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:49.797179 (+ 48us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:49.798111 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:49.798115 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:49.798120 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 23:00:49.798265 (+ 145us) client_negotiation.cc:240] Negotiation successful
0805 23:00:49.798392 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"thread_start_us":521,"threads_started":1}
I20260805 23:00:49.800355 29933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.786281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33095 (local address 127.0.0.1:40006)
0805 23:00:49.796471 (+ 10190us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:49.796497 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:49.796634 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:49.797346 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:49.797350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:49.797374 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:49.798165 (+ 791us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:49.798169 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:49.798194 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:49.798251 (+ 57us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:49.799076 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:49.799081 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:49.799086 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 23:00:49.799849 (+ 763us) client_negotiation.cc:240] Negotiation successful
0805 23:00:49.799913 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10037,"thread_start_us":9877,"threads_started":1}
I20260805 23:00:49.800855 29935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.787086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40006 (local address 127.22.45.65:33095)
0805 23:00:49.794973 (+ 7887us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.794982 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.796790 (+ 1808us) server_negotiation.cc:407] Connection header received
0805 23:00:49.796897 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.796908 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.797176 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.797332 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.798669 (+ 1337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.798678 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.798693 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.798714 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.798771 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.798791 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.799002 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.800356 (+ 1354us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.800478 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7674,"thread_start_us":7487,"threads_started":1}
I20260805 23:00:49.804263 29823 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8cda140fc043b39b8f5652ce0ac9d5 (DEFAULT_TABLE table=test-table [id=0ed5ea4291a940d7814eb650377bfaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:49.804329 29645 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8cda140fc043b39b8f5652ce0ac9d5 (DEFAULT_TABLE table=test-table [id=0ed5ea4291a940d7814eb650377bfaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:49.804730 29466 tablet_service.cc:1467] Processing CreateTablet for tablet 7d8cda140fc043b39b8f5652ce0ac9d5 (DEFAULT_TABLE table=test-table [id=0ed5ea4291a940d7814eb650377bfaaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:00:49.806104 29645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8cda140fc043b39b8f5652ce0ac9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:49.806097 29466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8cda140fc043b39b8f5652ce0ac9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:49.806105 29823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d8cda140fc043b39b8f5652ce0ac9d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:49.821480 29937 tablet_bootstrap.cc:492] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Bootstrap starting.
I20260805 23:00:49.824164 29939 tablet_bootstrap.cc:492] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Bootstrap starting.
I20260805 23:00:49.825678 29937 tablet_bootstrap.cc:654] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:49.825699 29941 tablet_bootstrap.cc:492] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Bootstrap starting.
I20260805 23:00:49.827025 29937 log.cc:824] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:49.827905 29939 tablet_bootstrap.cc:654] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:49.829298 29939 log.cc:824] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:49.829993 29941 tablet_bootstrap.cc:654] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:49.830655 29937 tablet_bootstrap.cc:492] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: No bootstrap required, opened a new log
I20260805 23:00:49.831091 29937 ts_tablet_manager.cc:1397] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260805 23:00:49.831470 29941 log.cc:824] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:49.833284 29939 tablet_bootstrap.cc:492] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: No bootstrap required, opened a new log
I20260805 23:00:49.833616 29939 ts_tablet_manager.cc:1397] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260805 23:00:49.835237 29941 tablet_bootstrap.cc:492] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: No bootstrap required, opened a new log
I20260805 23:00:49.835569 29941 ts_tablet_manager.cc:1397] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260805 23:00:49.839174 29937 raft_consensus.cc:348] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.839608 29937 raft_consensus.cc:374] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:49.839749 29937 raft_consensus.cc:729] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8ee6f1324924f60a1ff23fdd2928b43, State: Initialized, Role: FOLLOWER
I20260805 23:00:49.840397 29937 consensus_queue.cc:260] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.843001 29912 heartbeater.cc:503] Master 127.22.45.126:32927 was elected leader, sending a full tablet report...
I20260805 23:00:49.843819 29937 ts_tablet_manager.cc:1428] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260805 23:00:49.844610 29939 raft_consensus.cc:348] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.845134 29939 raft_consensus.cc:374] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:49.845253 29939 raft_consensus.cc:729] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a17c86c2f8c94351af9a1855bb4e6b24, State: Initialized, Role: FOLLOWER
I20260805 23:00:49.845963 29939 consensus_queue.cc:260] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.846349 29941 raft_consensus.cc:348] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.846977 29941 raft_consensus.cc:374] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:49.847132 29941 raft_consensus.cc:729] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baf735b6fdf7412ea290f675ce4b5da0, State: Initialized, Role: FOLLOWER
I20260805 23:00:49.848161 29939 ts_tablet_manager.cc:1428] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Time spent starting tablet: real 0.014s user 0.015s sys 0.001s
I20260805 23:00:49.847973 29941 consensus_queue.cc:260] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.849716 29941 ts_tablet_manager.cc:1428] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260805 23:00:49.851085 29738 heartbeater.cc:503] Master 127.22.45.126:32927 was elected leader, sending a full tablet report...
I20260805 23:00:49.910521 29952 raft_consensus.cc:482] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:00:49.910889 29952 raft_consensus.cc:504] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.912745 29952 leader_election.cc:288] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a17c86c2f8c94351af9a1855bb4e6b24 (127.22.45.65:33095), c8ee6f1324924f60a1ff23fdd2928b43 (127.22.45.67:41323)
I20260805 23:00:49.916498 29935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.913196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:35359 (local address 127.22.45.65:33095)
0805 23:00:49.913418 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.913426 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.914196 (+ 770us) server_negotiation.cc:407] Connection header received
0805 23:00:49.914370 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.914374 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.914438 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.914532 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.915741 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.915747 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.915752 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.915773 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.915810 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.915828 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.915951 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.916168 (+ 217us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.916237 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 23:00:49.917085 29954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.913277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:41323 (local address 127.22.45.66:54461)
0805 23:00:49.914285 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:49.914300 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:49.914416 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:49.914772 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:49.914777 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:49.914799 (+ 22us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:49.915758 (+ 959us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:49.915761 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:49.915777 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:49.915817 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:49.916457 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:49.916462 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:49.916468 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 23:00:49.916616 (+ 148us) client_negotiation.cc:240] Negotiation successful
0805 23:00:49.916670 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":897,"thread_start_us":569,"threads_started":1}
I20260805 23:00:49.917207 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.913459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:54461 (local address 127.22.45.67:41323)
0805 23:00:49.913669 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.913676 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.914420 (+ 744us) server_negotiation.cc:407] Connection header received
0805 23:00:49.914535 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.914539 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.914600 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.914694 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.915988 (+ 1294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.916021 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.916028 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.916052 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.916126 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.916146 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.916374 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.916896 (+ 522us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.916963 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 23:00:49.917320 29953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.913010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33095 (local address 127.22.45.66:35359)
0805 23:00:49.914054 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:49.914071 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:49.914230 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:49.914585 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:49.914589 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:49.914613 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:49.915470 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:00:49.915474 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:49.915492 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:00:49.915547 (+ 55us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:49.916017 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:49.916022 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:49.916027 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 23:00:49.916768 (+ 741us) client_negotiation.cc:240] Negotiation successful
0805 23:00:49.916825 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":904,"thread_start_us":651,"threads_started":1}
I20260805 23:00:49.918241 29851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cda140fc043b39b8f5652ce0ac9d5" candidate_uuid: "baf735b6fdf7412ea290f675ce4b5da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" is_pre_election: true
I20260805 23:00:49.918244 29497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cda140fc043b39b8f5652ce0ac9d5" candidate_uuid: "baf735b6fdf7412ea290f675ce4b5da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" is_pre_election: true
I20260805 23:00:49.918748 29851 raft_consensus.cc:2454] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baf735b6fdf7412ea290f675ce4b5da0 in term 0.
I20260805 23:00:49.918751 29497 raft_consensus.cc:2454] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baf735b6fdf7412ea290f675ce4b5da0 in term 0.
I20260805 23:00:49.919440 29590 leader_election.cc:302] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a17c86c2f8c94351af9a1855bb4e6b24, baf735b6fdf7412ea290f675ce4b5da0; no voters:
I20260805 23:00:49.919866 29952 raft_consensus.cc:2781] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:00:49.920008 29952 raft_consensus.cc:482] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:00:49.920138 29952 raft_consensus.cc:3037] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:49.922489 29952 raft_consensus.cc:504] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.923229 29952 leader_election.cc:288] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [CANDIDATE]: Term 1 election: Requested vote from peers a17c86c2f8c94351af9a1855bb4e6b24 (127.22.45.65:33095), c8ee6f1324924f60a1ff23fdd2928b43 (127.22.45.67:41323)
I20260805 23:00:49.923758 29497 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cda140fc043b39b8f5652ce0ac9d5" candidate_uuid: "baf735b6fdf7412ea290f675ce4b5da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a17c86c2f8c94351af9a1855bb4e6b24"
I20260805 23:00:49.923801 29851 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d8cda140fc043b39b8f5652ce0ac9d5" candidate_uuid: "baf735b6fdf7412ea290f675ce4b5da0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8ee6f1324924f60a1ff23fdd2928b43"
I20260805 23:00:49.923972 29497 raft_consensus.cc:3037] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:49.923993 29851 raft_consensus.cc:3037] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:49.926357 29851 raft_consensus.cc:2454] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baf735b6fdf7412ea290f675ce4b5da0 in term 1.
I20260805 23:00:49.926357 29497 raft_consensus.cc:2454] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baf735b6fdf7412ea290f675ce4b5da0 in term 1.
I20260805 23:00:49.926903 29587 leader_election.cc:302] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a17c86c2f8c94351af9a1855bb4e6b24, baf735b6fdf7412ea290f675ce4b5da0, c8ee6f1324924f60a1ff23fdd2928b43; no voters:
I20260805 23:00:49.927327 29952 raft_consensus.cc:2781] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:49.927850 29952 raft_consensus.cc:686] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 1 LEADER]: Becoming Leader. State: Replica: baf735b6fdf7412ea290f675ce4b5da0, State: Running, Role: LEADER
I20260805 23:00:49.928356 29952 consensus_queue.cc:237] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } }
I20260805 23:00:49.933333 29302 catalog_manager.cc:5495] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 reported cstate change: term changed from 0 to 1, leader changed from <none> to baf735b6fdf7412ea290f675ce4b5da0 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "baf735b6fdf7412ea290f675ce4b5da0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baf735b6fdf7412ea290f675ce4b5da0" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 35009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 } health_report { overall_health: UNKNOWN } } }
I20260805 23:00:49.955971 29931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:49.953981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59806 (local address 127.22.45.66:35009)
0805 23:00:49.954179 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:49.954184 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:49.954202 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:00:49.954376 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:49.954380 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:49.954470 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:49.954555 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:49.955424 (+ 869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:49.955428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:49.955431 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:49.955447 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:49.955481 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:49.955493 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:49.955600 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:49.955640 (+ 40us) server_negotiation.cc:299] Negotiation successful
0805 23:00:49.955689 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 23:00:49.965469 29851 raft_consensus.cc:1261] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 1 FOLLOWER]: Refusing update from remote peer baf735b6fdf7412ea290f675ce4b5da0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:49.965469 29497 raft_consensus.cc:1261] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 1 FOLLOWER]: Refusing update from remote peer baf735b6fdf7412ea290f675ce4b5da0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:00:49.966852 29952 consensus_queue.cc:1035] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a17c86c2f8c94351af9a1855bb4e6b24" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:49.967279 29955 consensus_queue.cc:1035] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8ee6f1324924f60a1ff23fdd2928b43" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 41323 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:00:49.982390 29960 mvcc.cc:205] Tried to move back new op lower bound from 7315336601446662144 to 7315336601310785536. Current Snapshot: MvccSnapshot[applied={T|T < 7315336601446662144}]
I20260805 23:00:50.002447 29304 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:50.002786 29304 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41214:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:00:50.007285 29304 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b3669852e8f744c5bb2f6bd473913a27: Sending DeleteTablet for 3 replicas of tablet 7d8cda140fc043b39b8f5652ce0ac9d5
I20260805 23:00:50.008912 29645 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8cda140fc043b39b8f5652ce0ac9d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:50 UTC) from {username='slave'} at 127.0.0.1:59794
I20260805 23:00:50.009223 29823 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8cda140fc043b39b8f5652ce0ac9d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:50 UTC) from {username='slave'} at 127.0.0.1:53630
I20260805 23:00:50.010063 29978 tablet_replica.cc:330] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: stopping tablet replica
I20260805 23:00:50.010174 29466 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d8cda140fc043b39b8f5652ce0ac9d5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:00:50 UTC) from {username='slave'} at 127.0.0.1:40006
I20260805 23:00:50.010648 29980 tablet_replica.cc:330] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: stopping tablet replica
I20260805 23:00:50.010664 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 29385
I20260805 23:00:50.010665 29978 raft_consensus.cc:2229] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:00:50.011165 29980 raft_consensus.cc:2229] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:50.012233 29980 raft_consensus.cc:2258] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:50.013975 29981 tablet_replica.cc:330] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: stopping tablet replica
I20260805 23:00:50.014559 29981 raft_consensus.cc:2229] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:00:50.015115 29980 ts_tablet_manager.cc:1905] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:50.015245 29981 raft_consensus.cc:2258] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:50.016626 29978 raft_consensus.cc:2258] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:00:50.018296 29981 ts_tablet_manager.cc:1905] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:50.018795 29978 ts_tablet_manager.cc:1905] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:00:50.023766 29980 ts_tablet_manager.cc:1918] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:50.024001 29980 log.cc:1196] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/7d8cda140fc043b39b8f5652ce0ac9d5
I20260805 23:00:50.024626 29980 ts_tablet_manager.cc:1939] T 7d8cda140fc043b39b8f5652ce0ac9d5 P c8ee6f1324924f60a1ff23fdd2928b43: Deleting consensus metadata
I20260805 23:00:50.026863 29281 catalog_manager.cc:4841] TS c8ee6f1324924f60a1ff23fdd2928b43 (127.22.45.67:41323): tablet 7d8cda140fc043b39b8f5652ce0ac9d5 (table test-table [id=0ed5ea4291a940d7814eb650377bfaaa]) successfully deleted
I20260805 23:00:50.027428 29981 ts_tablet_manager.cc:1918] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:50.027617 29981 log.cc:1196] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/7d8cda140fc043b39b8f5652ce0ac9d5
I20260805 23:00:50.027824 29978 ts_tablet_manager.cc:1918] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:00:50.028036 29978 log.cc:1196] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/7d8cda140fc043b39b8f5652ce0ac9d5
I20260805 23:00:50.028187 29981 ts_tablet_manager.cc:1939] T 7d8cda140fc043b39b8f5652ce0ac9d5 P a17c86c2f8c94351af9a1855bb4e6b24: Deleting consensus metadata
I20260805 23:00:50.028718 29978 ts_tablet_manager.cc:1939] T 7d8cda140fc043b39b8f5652ce0ac9d5 P baf735b6fdf7412ea290f675ce4b5da0: Deleting consensus metadata
I20260805 23:00:50.030027 29284 catalog_manager.cc:4841] TS a17c86c2f8c94351af9a1855bb4e6b24 (127.22.45.65:33095): tablet 7d8cda140fc043b39b8f5652ce0ac9d5 (table test-table [id=0ed5ea4291a940d7814eb650377bfaaa]) successfully deleted
I20260805 23:00:50.030459 29284 catalog_manager.cc:4841] TS baf735b6fdf7412ea290f675ce4b5da0 (127.22.45.66:35009): tablet 7d8cda140fc043b39b8f5652ce0ac9d5 (table test-table [id=0ed5ea4291a940d7814eb650377bfaaa]) successfully deleted
I20260805 23:00:50.031252 29935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:50.012341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40016 (local address 127.22.45.65:33095)
0805 23:00:50.012554 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:50.012562 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:50.016203 (+ 3641us) server_negotiation.cc:407] Connection header received
0805 23:00:50.023420 (+ 7217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:50.023427 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:50.023546 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:50.023639 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:50.030315 (+ 6676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:50.030321 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:50.030326 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:50.030354 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:50.030401 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:50.030419 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:50.030538 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:50.030830 (+ 292us) server_negotiation.cc:299] Negotiation successful
0805 23:00:50.030902 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:00:50.032079 29550 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:50.134457 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 29385
I20260805 23:00:50.165757 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 29564
I20260805 23:00:50.169468 29931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:50.166554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59820 (local address 127.22.45.66:35009)
0805 23:00:50.166752 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:50.166758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:50.166899 (+ 141us) server_negotiation.cc:407] Connection header received
0805 23:00:50.167129 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:50.167135 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:50.167211 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:50.167322 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:50.168710 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:50.168718 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:50.168722 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:50.168745 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:50.168792 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:50.168810 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:50.168945 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:50.169054 (+ 109us) server_negotiation.cc:299] Negotiation successful
0805 23:00:50.169130 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:00:50.170354 29730 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:50.290272 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 29564
I20260805 23:00:50.313673 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 29742
I20260805 23:00:50.316684 29934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:50.314537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53632 (local address 127.22.45.67:41323)
0805 23:00:50.314734 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:50.314740 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:50.314762 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:00:50.314934 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:50.314940 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:50.315034 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:50.315128 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:50.316000 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:50.316004 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:50.316008 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:50.316024 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:50.316058 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:50.316071 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:50.316196 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:50.316311 (+ 115us) server_negotiation.cc:299] Negotiation successful
0805 23:00:50.316381 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 23:00:50.317381 29907 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:50.409035 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 29742
I20260805 23:00:50.433899 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 29264
I20260805 23:00:50.435336 29344 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:50.547411 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 29264
2026-08-05T23:00:50Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2918 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260805 23:00:50.592720 22709 mini_oidc.cc:152] Starting JWKS server
I20260805 23:00:50.596035 22709 webserver.cc:460] Webserver started at https://127.0.0.1:42185/ using document root <none> and password file <none>
I20260805 23:00:50.596503 22709 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 23:00:50.597277 22709 webserver.cc:460] Webserver started at http://127.0.0.1:39447/ using document root <none> and password file <none>
2026-08-05T23:00:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:50Z Disabled control of system clock
I20260805 23:00:50.633459 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34471
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:41813
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:34471
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42185/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/testchainca.cert with env {}
W20260805 23:00:50.993914 29992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:50.994328 29992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:50.994465 29992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:51.003113 29992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:51.003294 29992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:51.003369 29992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:51.003459 29992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:51.003520 29992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 23:00:51.003613 29992 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 23:00:51.003664 29992 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42185/jwks.json
I20260805 23:00:51.014674 29992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:41813
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:34471
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42185/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:51.016460 29992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:51.017899 29992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:51.031512 30001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:51.031494 29999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:51.031834 29998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:51.032794 29992 server_base.cc:1034] running on GCE node
I20260805 23:00:51.033946 29992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:51.035981 29992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:51.037283 29992 hybrid_clock.cc:648] HybridClock initialized: now 1785970851037220 us; error 57 us; skew 500 ppm
I20260805 23:00:51.037863 29992 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:51.044935 29992 webserver.cc:460] Webserver started at http://127.22.45.126:40939/ using document root <none> and password file <none>
I20260805 23:00:51.045830 29992 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:51.045974 29992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:51.046335 29992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:51.049906 29992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "ad0e14e265604bcc87a6b1ce5d410e52"
format_stamp: "Formatted at 2026-08-05 23:00:51 on dist-test-slave-1vmg"
server_key: "cf4cda21938956ffaf7ea552dc33d7cd"
server_key_iv: "37f85f71fa89fecde0fab6711aae529b"
server_key_version: "encryptionkey@0"
I20260805 23:00:51.050881 29992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "ad0e14e265604bcc87a6b1ce5d410e52"
format_stamp: "Formatted at 2026-08-05 23:00:51 on dist-test-slave-1vmg"
server_key: "cf4cda21938956ffaf7ea552dc33d7cd"
server_key_iv: "37f85f71fa89fecde0fab6711aae529b"
server_key_version: "encryptionkey@0"
I20260805 23:00:51.057823 29992 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:00:51.062386 30010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:51.064085 29992 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:00:51.064318 29992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "ad0e14e265604bcc87a6b1ce5d410e52"
format_stamp: "Formatted at 2026-08-05 23:00:51 on dist-test-slave-1vmg"
server_key: "cf4cda21938956ffaf7ea552dc33d7cd"
server_key_iv: "37f85f71fa89fecde0fab6711aae529b"
server_key_version: "encryptionkey@0"
I20260805 23:00:51.064565 29992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:51.080734 29992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:51.081724 29992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:51.082062 29992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:51.101182 29992 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:34471
I20260805 23:00:51.101217 30077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:34471 every 8 connection(s)
I20260805 23:00:51.102730 29992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:51.107283 30078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:51.108763 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 29992
I20260805 23:00:51.109005 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:51.109611 22709 external_mini_cluster.cc:1428] Setting key e566f00bb9a37cd585548f78f619fde7
I20260805 23:00:51.122517 30078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52: Bootstrap starting.
I20260805 23:00:51.125666 30083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:51.111766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35588 (local address 127.22.45.126:34471)
0805 23:00:51.112994 (+ 1228us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:51.113009 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:51.113068 (+ 59us) server_negotiation.cc:407] Connection header received
0805 23:00:51.114871 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:51.114939 (+ 68us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:51.115658 (+ 719us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:51.116111 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:51.116714 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.118649 (+ 1935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.120158 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.121250 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.121435 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:51.122658 (+ 1223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:51.122670 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:51.122691 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:51.123453 (+ 762us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:51.123561 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:51.123589 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:51.123709 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:51.123975 (+ 266us) server_negotiation.cc:299] Negotiation successful
0805 23:00:51.124332 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":376,"threads_started":1}
I20260805 23:00:51.126659 30078 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:51.128047 30078 log.cc:824] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:51.130126 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:00:51.131318 30078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52: No bootstrap required, opened a new log
I20260805 23:00:51.139961 30078 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34471 } }
I20260805 23:00:51.140437 30078 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:51.140539 30078 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad0e14e265604bcc87a6b1ce5d410e52, State: Initialized, Role: FOLLOWER
I20260805 23:00:51.141215 30078 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34471 } }
I20260805 23:00:51.141469 30078 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:51.141614 30078 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:51.141775 30078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:51.144446 30078 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34471 } }
I20260805 23:00:51.145118 30078 leader_election.cc:302] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad0e14e265604bcc87a6b1ce5d410e52; no voters:
I20260805 23:00:51.145733 30078 leader_election.cc:288] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:51.145895 30085 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:51.146595 30085 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [term 1 LEADER]: Becoming Leader. State: Replica: ad0e14e265604bcc87a6b1ce5d410e52, State: Running, Role: LEADER
I20260805 23:00:51.147189 30085 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34471 } }
I20260805 23:00:51.147969 30078 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:51.149847 30086 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34471 } } }
I20260805 23:00:51.150358 30086 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:51.150064 30087 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad0e14e265604bcc87a6b1ce5d410e52. Latest consensus state: current_term: 1 leader_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad0e14e265604bcc87a6b1ce5d410e52" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34471 } } }
I20260805 23:00:51.150672 30087 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:51.153578 30096 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:51.159847 30096 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:51.170871 30096 catalog_manager.cc:1347] Generated new cluster ID: 67e8a2ff4fc540938e5347dca57f048e
I20260805 23:00:51.171066 30096 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:51.203490 30096 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:51.204910 30096 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:51.229707 30096 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad0e14e265604bcc87a6b1ce5d410e52: Generated new TSK 0
I20260805 23:00:51.230697 30096 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 23:00:51.284463 30115 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260805 23:00:51.284718 30115 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 23:00:51.285984 30083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:51.262015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35604 (local address 127.22.45.126:34471)
0805 23:00:51.262311 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:51.262319 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:51.263062 (+ 743us) server_negotiation.cc:407] Connection header received
0805 23:00:51.263599 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:51.263606 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:51.263693 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:51.263838 (+ 145us) server_negotiation.cc:226] Negotiated authn=JWT
0805 23:00:51.264604 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.265404 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.267773 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.268326 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.268456 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:51.269370 (+ 914us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 23:00:51.285373 (+ 16003us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42185/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 23:00:51.285727 (+ 354us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35604: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42185/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":75}
W20260805 23:00:51.286140 30083 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35604: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42185/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260805 23:00:51.288246 30114 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:51.261840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34471 (local address 127.0.0.1:35604)
0805 23:00:51.262879 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:51.262903 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:51.263184 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:51.263903 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:51.263909 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:51.263925 (+ 16us) client_negotiation.cc:189] Negotiated authn=JWT
0805 23:00:51.264380 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:51.264393 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.265592 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.265599 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:51.267525 (+ 1926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:51.267547 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.268605 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.268613 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:51.268824 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:51.268935 (+ 111us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 23:00:51.285750 (+ 16815us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42185/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0805 23:00:51.286175 (+ 425us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.45.126:34471: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42185/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":805,"thread_start_us":643,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.22.45.126:34471: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42185/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260805 23:00:51.290475 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 29992
I20260805 23:00:51.291916 30071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:51.400185 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 29992
2026-08-05T23:00:51Z chronyd exiting
I20260805 23:00:51.456548 22709 test_util.cc:175] -----------------------------------------------
I20260805 23:00:51.456727 22709 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1785970804553337-22709-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (869 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260805 23:00:51.460985 22709 mini_oidc.cc:152] Starting JWKS server
I20260805 23:00:51.463119 22709 webserver.cc:460] Webserver started at https://127.0.0.1:37789/ using document root <none> and password file <none>
I20260805 23:00:51.463363 22709 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 23:00:51.464118 22709 webserver.cc:460] Webserver started at http://127.0.0.1:37691/ using document root <none> and password file <none>
2026-08-05T23:00:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:51Z Disabled control of system clock
I20260805 23:00:51.501858 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:33271
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:46471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:33271
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37789/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/testchainca.cert with env {}
W20260805 23:00:51.857254 30125 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:51.857620 30125 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:51.857764 30125 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:51.865458 30125 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:51.865620 30125 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:51.865700 30125 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:51.865788 30125 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:51.865854 30125 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 23:00:51.865944 30125 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 23:00:51.865999 30125 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37789/jwks.json
I20260805 23:00:51.876626 30125 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:46471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:33271
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:33271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37789/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:51.878120 30125 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:51.879598 30125 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:51.892583 30131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:51.892632 30132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:51.892539 30136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:51.893595 30125 server_base.cc:1034] running on GCE node
I20260805 23:00:51.894595 30125 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:51.896402 30125 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:51.897660 30125 hybrid_clock.cc:648] HybridClock initialized: now 1785970851897598 us; error 67 us; skew 500 ppm
I20260805 23:00:51.898077 30125 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:51.900790 30125 webserver.cc:460] Webserver started at http://127.22.45.126:46707/ using document root <none> and password file <none>
I20260805 23:00:51.901651 30125 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:51.901796 30125 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:51.902206 30125 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:51.905630 30125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "6a547f8063084d7894b8ce5c4914c0f7"
format_stamp: "Formatted at 2026-08-05 23:00:51 on dist-test-slave-1vmg"
server_key: "77aa0c8e250d7c6b79cbe869c913e138"
server_key_iv: "16f6bf91d2125fbe89c644e0a8d800ed"
server_key_version: "encryptionkey@0"
I20260805 23:00:51.906620 30125 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "6a547f8063084d7894b8ce5c4914c0f7"
format_stamp: "Formatted at 2026-08-05 23:00:51 on dist-test-slave-1vmg"
server_key: "77aa0c8e250d7c6b79cbe869c913e138"
server_key_iv: "16f6bf91d2125fbe89c644e0a8d800ed"
server_key_version: "encryptionkey@0"
I20260805 23:00:51.913084 30125 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260805 23:00:51.917624 30145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:51.919504 30125 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260805 23:00:51.919767 30125 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "6a547f8063084d7894b8ce5c4914c0f7"
format_stamp: "Formatted at 2026-08-05 23:00:51 on dist-test-slave-1vmg"
server_key: "77aa0c8e250d7c6b79cbe869c913e138"
server_key_iv: "16f6bf91d2125fbe89c644e0a8d800ed"
server_key_version: "encryptionkey@0"
I20260805 23:00:51.920025 30125 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:51.942148 30125 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:51.943218 30125 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:51.943557 30125 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:51.962998 30125 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:33271
I20260805 23:00:51.963034 30210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:33271 every 8 connection(s)
I20260805 23:00:51.964620 30125 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:51.969175 30211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:51.969344 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 30125
I20260805 23:00:51.969552 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:51.970221 22709 external_mini_cluster.cc:1428] Setting key 5d8026a40f27564153e1c243e339cb12
I20260805 23:00:51.983047 30211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7: Bootstrap starting.
I20260805 23:00:51.985600 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:51.972431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36290 (local address 127.22.45.126:33271)
0805 23:00:51.973635 (+ 1204us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:51.973648 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:51.973703 (+ 55us) server_negotiation.cc:407] Connection header received
0805 23:00:51.975945 (+ 2242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:51.975980 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:51.976656 (+ 676us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:51.977116 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:51.977774 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.979229 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.980653 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:51.981453 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:51.981644 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:51.982988 (+ 1344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:51.983001 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:51.983024 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:51.983687 (+ 663us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:51.983784 (+ 97us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:51.983809 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:51.983931 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:51.984170 (+ 239us) server_negotiation.cc:299] Negotiation successful
0805 23:00:51.984550 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":691,"thread_start_us":430,"threads_started":1}
I20260805 23:00:51.986984 30211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:51.988226 30211 log.cc:824] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:51.990043 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:00:51.991634 30211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7: No bootstrap required, opened a new log
I20260805 23:00:51.999663 30211 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a547f8063084d7894b8ce5c4914c0f7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33271 } }
I20260805 23:00:52.000168 30211 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:52.000288 30211 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a547f8063084d7894b8ce5c4914c0f7, State: Initialized, Role: FOLLOWER
I20260805 23:00:52.000957 30211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a547f8063084d7894b8ce5c4914c0f7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33271 } }
I20260805 23:00:52.001247 30211 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:52.001391 30211 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:52.001585 30211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:52.004124 30211 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a547f8063084d7894b8ce5c4914c0f7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33271 } }
I20260805 23:00:52.004793 30211 leader_election.cc:302] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6a547f8063084d7894b8ce5c4914c0f7; no voters:
I20260805 23:00:52.005488 30211 leader_election.cc:288] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:52.005692 30217 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:52.006536 30217 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [term 1 LEADER]: Becoming Leader. State: Replica: 6a547f8063084d7894b8ce5c4914c0f7, State: Running, Role: LEADER
I20260805 23:00:52.007377 30217 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a547f8063084d7894b8ce5c4914c0f7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33271 } }
I20260805 23:00:52.008617 30211 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:52.010527 30218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6a547f8063084d7894b8ce5c4914c0f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a547f8063084d7894b8ce5c4914c0f7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33271 } } }
I20260805 23:00:52.010499 30221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6a547f8063084d7894b8ce5c4914c0f7. Latest consensus state: current_term: 1 leader_uuid: "6a547f8063084d7894b8ce5c4914c0f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6a547f8063084d7894b8ce5c4914c0f7" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33271 } } }
I20260805 23:00:52.011015 30218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:52.011015 30221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:52.014243 30224 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:52.021265 30224 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:52.030599 30224 catalog_manager.cc:1347] Generated new cluster ID: 2243dc2e454b4a57a1441df120224ec2
I20260805 23:00:52.030740 30224 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:52.067261 30224 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:52.068719 30224 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:52.076431 30224 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6a547f8063084d7894b8ce5c4914c0f7: Generated new TSK 0
I20260805 23:00:52.077389 30224 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260805 23:00:52.126497 30256 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260805 23:00:52.126677 30256 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 23:00:52.127744 30215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:52.099569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36304 (local address 127.22.45.126:33271)
0805 23:00:52.099784 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:52.099791 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:52.100221 (+ 430us) server_negotiation.cc:407] Connection header received
0805 23:00:52.100495 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:52.100501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:52.100590 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:52.100746 (+ 156us) server_negotiation.cc:226] Negotiated authn=JWT
0805 23:00:52.101278 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.102156 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.103946 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.104446 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.104593 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:52.105185 (+ 592us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 23:00:52.126903 (+ 21718us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 23:00:52.127396 (+ 493us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36304: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":63}
W20260805 23:00:52.127911 30215 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36304: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260805 23:00:52.127967 30255 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:52.099441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:33271 (local address 127.0.0.1:36304)
0805 23:00:52.100093 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:52.100112 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:52.100274 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:52.100784 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:52.100789 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:52.100802 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0805 23:00:52.101081 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:52.101090 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.102331 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.102336 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:52.103735 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:52.103752 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.104656 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.104663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:52.104820 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:52.104864 (+ 44us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 23:00:52.127239 (+ 22375us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0805 23:00:52.127547 (+ 308us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.45.126:33271: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37789/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":373,"threads_started":1}
I20260805 23:00:52.129848 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 30125
I20260805 23:00:52.131386 30205 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:52.233976 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 30125
2026-08-05T23:00:52Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (839 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260805 23:00:52.300087 22709 mini_oidc.cc:152] Starting JWKS server
I20260805 23:00:52.302289 22709 webserver.cc:460] Webserver started at https://127.0.0.1:35791/ using document root <none> and password file <none>
I20260805 23:00:52.302572 22709 mini_oidc.cc:189] Starting OIDC Discovery server
I20260805 23:00:52.303414 22709 webserver.cc:460] Webserver started at http://127.0.0.1:45529/ using document root <none> and password file <none>
2026-08-05T23:00:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:52Z Disabled control of system clock
I20260805 23:00:52.339576 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38045
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:36119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:38045
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35791/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 23:00:52.698153 30264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:52.698527 30264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:52.698654 30264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:52.706765 30264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:52.706959 30264 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:52.707031 30264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:52.707113 30264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:52.707178 30264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 23:00:52.707269 30264 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 23:00:52.707325 30264 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35791/jwks.json
I20260805 23:00:52.717823 30264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:38045
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35791/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:52.719429 30264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:52.721521 30264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:52.734990 30275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:52.735141 30272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:52.735244 30271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:52.736176 30264 server_base.cc:1034] running on GCE node
I20260805 23:00:52.737460 30264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:52.739742 30264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:52.741046 30264 hybrid_clock.cc:648] HybridClock initialized: now 1785970852740986 us; error 50 us; skew 500 ppm
I20260805 23:00:52.741490 30264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:52.744302 30264 webserver.cc:460] Webserver started at http://127.22.45.126:38763/ using document root <none> and password file <none>
I20260805 23:00:52.745110 30264 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:52.745229 30264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:52.745558 30264 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:52.749066 30264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "acee0903b3434ee2aca3761d2bb9e7b4"
format_stamp: "Formatted at 2026-08-05 23:00:52 on dist-test-slave-1vmg"
server_key: "1853af9cf5ef29a141f98b0e21ec933b"
server_key_iv: "00a1a3a6d137b4dfc3a3d671bfb15030"
server_key_version: "encryptionkey@0"
I20260805 23:00:52.750038 30264 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "acee0903b3434ee2aca3761d2bb9e7b4"
format_stamp: "Formatted at 2026-08-05 23:00:52 on dist-test-slave-1vmg"
server_key: "1853af9cf5ef29a141f98b0e21ec933b"
server_key_iv: "00a1a3a6d137b4dfc3a3d671bfb15030"
server_key_version: "encryptionkey@0"
I20260805 23:00:52.756592 30264 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 23:00:52.761121 30282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:52.762809 30264 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:00:52.763062 30264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "acee0903b3434ee2aca3761d2bb9e7b4"
format_stamp: "Formatted at 2026-08-05 23:00:52 on dist-test-slave-1vmg"
server_key: "1853af9cf5ef29a141f98b0e21ec933b"
server_key_iv: "00a1a3a6d137b4dfc3a3d671bfb15030"
server_key_version: "encryptionkey@0"
I20260805 23:00:52.763307 30264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:52.791257 30264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:52.792261 30264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:52.792573 30264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:52.812740 30264 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:38045
I20260805 23:00:52.812758 30345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:38045 every 8 connection(s)
I20260805 23:00:52.814287 30264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:52.816104 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 30264
I20260805 23:00:52.816355 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:52.817194 22709 external_mini_cluster.cc:1428] Setting key 327985b6dfc5038b6bd3a1240bc6b911
I20260805 23:00:52.819694 30346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:52.835494 30350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:52.819445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48220 (local address 127.22.45.126:38045)
0805 23:00:52.820616 (+ 1171us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:52.820632 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:52.820694 (+ 62us) server_negotiation.cc:407] Connection header received
0805 23:00:52.823036 (+ 2342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:52.823069 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:52.823805 (+ 736us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:52.824357 (+ 552us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:52.824965 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.827126 (+ 2161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.828726 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.829813 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.830034 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:52.831370 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:52.831382 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:52.831405 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:52.832261 (+ 856us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:52.832390 (+ 129us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:52.832422 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:52.832561 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:52.833012 (+ 451us) server_negotiation.cc:299] Negotiation successful
0805 23:00:52.833693 (+ 681us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":376,"threads_started":1}
I20260805 23:00:52.836184 30346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4: Bootstrap starting.
I20260805 23:00:52.840842 30346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:52.842232 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:00:52.842299 30346 log.cc:824] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:52.846449 30346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4: No bootstrap required, opened a new log
I20260805 23:00:52.855121 30346 raft_consensus.cc:348] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38045 } }
I20260805 23:00:52.855619 30346 raft_consensus.cc:374] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:52.855719 30346 raft_consensus.cc:729] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acee0903b3434ee2aca3761d2bb9e7b4, State: Initialized, Role: FOLLOWER
I20260805 23:00:52.856408 30346 consensus_queue.cc:260] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38045 } }
I20260805 23:00:52.856676 30346 raft_consensus.cc:388] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:52.856833 30346 raft_consensus.cc:482] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:52.857025 30346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:52.859516 30346 raft_consensus.cc:504] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38045 } }
I20260805 23:00:52.860154 30346 leader_election.cc:302] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acee0903b3434ee2aca3761d2bb9e7b4; no voters:
I20260805 23:00:52.860805 30346 leader_election.cc:288] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:52.860980 30352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:52.861768 30352 raft_consensus.cc:686] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [term 1 LEADER]: Becoming Leader. State: Replica: acee0903b3434ee2aca3761d2bb9e7b4, State: Running, Role: LEADER
I20260805 23:00:52.862370 30352 consensus_queue.cc:237] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38045 } }
I20260805 23:00:52.863183 30346 sys_catalog.cc:564] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:52.865527 30356 sys_catalog.cc:455] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38045 } } }
I20260805 23:00:52.866030 30356 sys_catalog.cc:458] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:52.866578 30357 sys_catalog.cc:455] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader acee0903b3434ee2aca3761d2bb9e7b4. Latest consensus state: current_term: 1 leader_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acee0903b3434ee2aca3761d2bb9e7b4" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38045 } } }
I20260805 23:00:52.867000 30357 sys_catalog.cc:458] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:52.867254 30364 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:52.875962 30364 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:52.886263 30364 catalog_manager.cc:1347] Generated new cluster ID: c86372597b0e443ab9e037257a8f268c
I20260805 23:00:52.886420 30364 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:52.907135 30364 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:52.909067 30364 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:52.918030 30364 catalog_manager.cc:5868] T 00000000000000000000000000000000 P acee0903b3434ee2aca3761d2bb9e7b4: Generated new TSK 0
I20260805 23:00:52.918951 30364 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:00:52.955173 30350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:52.946085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48236 (local address 127.22.45.126:38045)
0805 23:00:52.946263 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:52.946267 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:52.946685 (+ 418us) server_negotiation.cc:407] Connection header received
0805 23:00:52.946970 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:52.946975 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:52.947062 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:52.947219 (+ 157us) server_negotiation.cc:226] Negotiated authn=JWT
0805 23:00:52.947795 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.948555 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.950618 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.951199 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.951310 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:52.952029 (+ 719us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 23:00:52.954451 (+ 2422us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35791/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 23:00:52.954818 (+ 367us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48236: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35791/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":51}
W20260805 23:00:52.955314 30350 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48236: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35791/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260805 23:00:52.957269 30389 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:52.945867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38045 (local address 127.0.0.1:48236)
0805 23:00:52.946554 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:52.946576 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:52.946753 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:52.947256 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:52.947262 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:52.947276 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0805 23:00:52.947635 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:52.947648 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.948706 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.948712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:52.950402 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:52.950420 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:52.951414 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:52.951421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:52.951631 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:52.951685 (+ 54us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 23:00:52.954706 (+ 3021us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35791/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0805 23:00:52.956812 (+ 2106us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.45.126:38045: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35791/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":534,"mutex_wait_us":1697,"thread_start_us":395,"threads_started":1}
I20260805 23:00:52.958494 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 30264
I20260805 23:00:52.960032 30339 generic_service.cc:196] Checking for leaks (request via RPC)
E20260805 23:00:52.969848 30391 webserver.cc:533] Webserver: sslize failed:
E20260805 23:00:52.970032 30391 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260805 23:00:53.058238 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 30264
2026-08-05T23:00:53Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (822 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-05T23:00:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:53Z Disabled control of system clock
I20260805 23:00:53.160712 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45535
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:35297
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:45535
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/testchainca.cert with env {}
W20260805 23:00:53.517191 30397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:53.517565 30397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:53.517670 30397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:53.525554 30397 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:53.525727 30397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:53.525775 30397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:53.525836 30397 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:53.525879 30397 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260805 23:00:53.525949 30397 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260805 23:00:53.525990 30397 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260805 23:00:53.536727 30397 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:35297
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:45535
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45535
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:53.538180 30397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:53.539551 30397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:53.551667 30410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:53.551702 30404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:53.551733 30407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:53.552484 30397 server_base.cc:1034] running on GCE node
I20260805 23:00:53.553359 30397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:53.555051 30397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:53.556295 30397 hybrid_clock.cc:648] HybridClock initialized: now 1785970853556243 us; error 50 us; skew 500 ppm
I20260805 23:00:53.556701 30397 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:00:53.559122 30397 webserver.cc:460] Webserver started at http://127.22.45.126:35571/ using document root <none> and password file <none>
I20260805 23:00:53.559887 30397 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:53.560003 30397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:53.560313 30397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:53.563393 30397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "3a5a119773ac4de0ba9826ecbcd45f13"
format_stamp: "Formatted at 2026-08-05 23:00:53 on dist-test-slave-1vmg"
server_key: "758cb66d9d05e4e554c54efb80d1fe6f"
server_key_iv: "01683a4c93d700447c8045069603eea4"
server_key_version: "encryptionkey@0"
I20260805 23:00:53.564240 30397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "3a5a119773ac4de0ba9826ecbcd45f13"
format_stamp: "Formatted at 2026-08-05 23:00:53 on dist-test-slave-1vmg"
server_key: "758cb66d9d05e4e554c54efb80d1fe6f"
server_key_iv: "01683a4c93d700447c8045069603eea4"
server_key_version: "encryptionkey@0"
I20260805 23:00:53.570580 30397 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 23:00:53.575099 30417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:53.576930 30397 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:00:53.577173 30397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "3a5a119773ac4de0ba9826ecbcd45f13"
format_stamp: "Formatted at 2026-08-05 23:00:53 on dist-test-slave-1vmg"
server_key: "758cb66d9d05e4e554c54efb80d1fe6f"
server_key_iv: "01683a4c93d700447c8045069603eea4"
server_key_version: "encryptionkey@0"
I20260805 23:00:53.577466 30397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:53.597126 30397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:53.598376 30397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:53.598707 30397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:53.617794 30397 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:45535
I20260805 23:00:53.617834 30484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:45535 every 8 connection(s)
I20260805 23:00:53.619298 30397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:53.623549 30485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:00:53.628859 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 30397
I20260805 23:00:53.629072 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:53.629724 22709 external_mini_cluster.cc:1428] Setting key 5fa69c47b72fcecf7eef64d1aafbd445
I20260805 23:00:53.636710 30485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13: Bootstrap starting.
I20260805 23:00:53.641290 30485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:53.642576 30485 log.cc:824] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:53.646976 30485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13: No bootstrap required, opened a new log
I20260805 23:00:53.647874 30488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:53.631894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34760 (local address 127.22.45.126:45535)
0805 23:00:53.633157 (+ 1263us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:53.633188 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:53.633250 (+ 62us) server_negotiation.cc:407] Connection header received
0805 23:00:53.635722 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:53.635756 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:53.636492 (+ 736us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:53.637002 (+ 510us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:53.637845 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:53.639957 (+ 2112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:53.641614 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:53.642469 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:53.642703 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:53.644219 (+ 1516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:53.644238 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:53.644265 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:00:53.645229 (+ 964us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:53.645356 (+ 127us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:00:53.645388 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:53.645535 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:53.645834 (+ 299us) server_negotiation.cc:299] Negotiation successful
0805 23:00:53.646256 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":362,"threads_started":1}
I20260805 23:00:53.652999 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:00:53.657867 30485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45535 } }
I20260805 23:00:53.658294 30485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:53.658373 30485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a5a119773ac4de0ba9826ecbcd45f13, State: Initialized, Role: FOLLOWER
I20260805 23:00:53.658938 30485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45535 } }
I20260805 23:00:53.659171 30485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:53.659293 30485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:53.659435 30485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:53.661795 30485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45535 } }
I20260805 23:00:53.662392 30485 leader_election.cc:302] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a5a119773ac4de0ba9826ecbcd45f13; no voters:
I20260805 23:00:53.663085 30485 leader_election.cc:288] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:53.663280 30491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:53.664359 30491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [term 1 LEADER]: Becoming Leader. State: Replica: 3a5a119773ac4de0ba9826ecbcd45f13, State: Running, Role: LEADER
I20260805 23:00:53.664934 30491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45535 } }
I20260805 23:00:53.665465 30485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:53.667924 30493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a5a119773ac4de0ba9826ecbcd45f13. Latest consensus state: current_term: 1 leader_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45535 } } }
I20260805 23:00:53.668249 30493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:53.669166 30499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:53.667807 30492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a5a119773ac4de0ba9826ecbcd45f13" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45535 } } }
I20260805 23:00:53.669495 30492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:53.675595 30499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:53.686159 30499 catalog_manager.cc:1347] Generated new cluster ID: aa33c4ed0fc74f87b2cf7c2bec30e464
I20260805 23:00:53.686393 30499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:53.699285 30499 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:53.701500 30499 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:53.722707 30499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a5a119773ac4de0ba9826ecbcd45f13: Generated new TSK 0
I20260805 23:00:53.723776 30499 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:00:54.165057 30488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:53.739375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34766 (local address 127.22.45.126:45535)
0805 23:00:53.739601 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:53.739608 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:53.740083 (+ 475us) server_negotiation.cc:407] Connection header received
0805 23:00:53.740286 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:53.740293 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:53.740396 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:53.740580 (+ 184us) server_negotiation.cc:226] Negotiated authn=JWT
0805 23:00:53.741006 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:53.742108 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:53.743643 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:53.744342 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:53.744477 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:53.744959 (+ 482us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0805 23:00:54.164181 (+419222us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 23:00:54.164704 (+ 523us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34766: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":69}
W20260805 23:00:54.165481 30488 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34766: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260805 23:00:54.165688 30523 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:53.739325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45535 (local address 127.0.0.1:34766)
0805 23:00:53.739973 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:53.739990 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:53.740123 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:53.740579 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:53.740582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:53.740591 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0805 23:00:53.740857 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:53.740865 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:53.742276 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:53.742282 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:53.743479 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:53.743493 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:53.744509 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:53.744513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:53.744642 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:53.744679 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0805 23:00:54.164683 (+420004us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0805 23:00:54.165044 (+ 361us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.45.126:45535: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":333,"threads_started":1}
I20260805 23:00:54.167213 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 30397
I20260805 23:00:54.168622 30479 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:54.281168 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 30397
2026-08-05T23:00:54Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1207 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (452 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (464 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:55 dist-test-slave-1vmg krb5kdc[30545](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:55 dist-test-slave-1vmg krb5kdc[30545](info): set up 2 sockets
Aug 05 23:00:55 dist-test-slave-1vmg krb5kdc[30545](info): commencing operation
krb5kdc: starting...
W20260805 23:00:56.416769 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.168s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:00:56 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:00:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:00:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:00:56.679028 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46679
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:46679
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:57.052202 30563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:57.052544 30563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:57.052672 30563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:57.060371 30563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:00:57.060520 30563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:57.060571 30563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:57.060654 30563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:00:57.060719 30563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:00:57.071571 30563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:46679
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:57.073167 30563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:57.075073 30563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:57.088440 30570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:57.088440 30571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:57.088881 30573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:57.089385 30563 server_base.cc:1034] running on GCE node
I20260805 23:00:57.090279 30563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:57.091936 30563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:57.093161 30563 hybrid_clock.cc:648] HybridClock initialized: now 1785970857093107 us; error 69 us; skew 500 ppm
I20260805 23:00:57.093533 30563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:57 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970857, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:57.100006 30563 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:00:57.102226 30563 webserver.cc:460] Webserver started at http://127.22.45.126:44335/ using document root <none> and password file <none>
I20260805 23:00:57.103307 30563 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:57.103459 30563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:57.103816 30563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:57.107605 30563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "51b700f51ff345179672845a64bad026"
format_stamp: "Formatted at 2026-08-05 23:00:57 on dist-test-slave-1vmg"
server_key: "0b38e025396297766997561a4a9ad104"
server_key_iv: "304136cc8b4f2204ced16ade5132aa98"
server_key_version: "encryptionkey@0"
I20260805 23:00:57.108580 30563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "51b700f51ff345179672845a64bad026"
format_stamp: "Formatted at 2026-08-05 23:00:57 on dist-test-slave-1vmg"
server_key: "0b38e025396297766997561a4a9ad104"
server_key_iv: "304136cc8b4f2204ced16ade5132aa98"
server_key_version: "encryptionkey@0"
I20260805 23:00:57.115688 30563 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260805 23:00:57.121429 30581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:57.123883 30563 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260805 23:00:57.124203 30563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "51b700f51ff345179672845a64bad026"
format_stamp: "Formatted at 2026-08-05 23:00:57 on dist-test-slave-1vmg"
server_key: "0b38e025396297766997561a4a9ad104"
server_key_iv: "304136cc8b4f2204ced16ade5132aa98"
server_key_version: "encryptionkey@0"
I20260805 23:00:57.124475 30563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:57.158237 30563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:57.163141 30563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:57.163416 30563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:57.182806 30563 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:46679
I20260805 23:00:57.182869 30649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:46679 every 8 connection(s)
I20260805 23:00:57.184417 30563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:00:57.186846 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 30563
I20260805 23:00:57.187129 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:00:57.187984 22709 external_mini_cluster.cc:1428] Setting key 2112ca0f1348bd5c43bd7c3060b0fb2e
I20260805 23:00:57.189473 30650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:00:57 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970856, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:57.205694 30650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026: Bootstrap starting.
I20260805 23:00:57.209713 30650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026: Neither blocks nor log segments found. Creating new log.
I20260805 23:00:57.210817 30650 log.cc:824] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026: Log is configured to *not* fsync() on all Append() calls
I20260805 23:00:57.213964 30650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026: No bootstrap required, opened a new log
I20260805 23:00:57.214180 30656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:57.190401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47162 (local address 127.22.45.126:46679)
0805 23:00:57.191290 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:57.191303 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:57.191348 (+ 45us) server_negotiation.cc:407] Connection header received
0805 23:00:57.193712 (+ 2364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:57.193741 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:57.194287 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:57.194696 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:57.196764 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:57.198273 (+ 1509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:57.200127 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:57.200900 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:57.201128 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:57.206208 (+ 5080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:57.206247 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:57.206265 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:57.206340 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:57.209822 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:57.210590 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:57.210597 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:57.210605 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:57.210811 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:57.211279 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:57.211283 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:57.211285 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:57.211889 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:57.212199 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:57.212712 (+ 513us) server_negotiation.cc:299] Negotiation successful
0805 23:00:57.213134 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":412,"threads_started":1}
I20260805 23:00:57.222467 30650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b700f51ff345179672845a64bad026" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46679 } }
I20260805 23:00:57.222990 30650 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:00:57.223112 30650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51b700f51ff345179672845a64bad026, State: Initialized, Role: FOLLOWER
I20260805 23:00:57.223788 30650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b700f51ff345179672845a64bad026" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46679 } }
I20260805 23:00:57.224035 30650 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:00:57.224182 30650 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:00:57.224354 30650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:00:57.226635 30650 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b700f51ff345179672845a64bad026" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46679 } }
I20260805 23:00:57.227263 30650 leader_election.cc:302] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51b700f51ff345179672845a64bad026; no voters:
I20260805 23:00:57.227914 30650 leader_election.cc:288] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:00:57.228057 30658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:00:57.228830 30658 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [term 1 LEADER]: Becoming Leader. State: Replica: 51b700f51ff345179672845a64bad026, State: Running, Role: LEADER
I20260805 23:00:57.229386 30658 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b700f51ff345179672845a64bad026" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46679 } }
I20260805 23:00:57.230289 30650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:00:57.232169 30661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51b700f51ff345179672845a64bad026. Latest consensus state: current_term: 1 leader_uuid: "51b700f51ff345179672845a64bad026" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b700f51ff345179672845a64bad026" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46679 } } }
I20260805 23:00:57.232686 30661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:57.232545 30660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51b700f51ff345179672845a64bad026" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51b700f51ff345179672845a64bad026" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46679 } } }
I20260805 23:00:57.232843 30660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026 [sys.catalog]: This master's current role is: LEADER
I20260805 23:00:57.235584 30666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:00:57.242861 30666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:00:57.253571 30666 catalog_manager.cc:1347] Generated new cluster ID: 5f8df71c460746ac9edefa496d3c6d44
I20260805 23:00:57.253912 30666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:00:57.273602 30666 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:00:57.275131 30666 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:00:57.288353 30666 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51b700f51ff345179672845a64bad026: Generated new TSK 0
I20260805 23:00:57.289337 30666 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:00:57.352753 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46679
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:57.725208 30683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:57.725565 30683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:57.725672 30683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:57.733842 30683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:57.733987 30683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:57.734107 30683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:00:57.744851 30683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:57.746299 30683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:57.747774 30683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:57.762411 30695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:57.762478 30693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:57.762450 30691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:57.763403 30683 server_base.cc:1034] running on GCE node
I20260805 23:00:57.764088 30683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:57.765089 30683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:57.766283 30683 hybrid_clock.cc:648] HybridClock initialized: now 1785970857766228 us; error 53 us; skew 500 ppm
I20260805 23:00:57.766577 30683 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:57 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970857, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:57.769954 30683 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:00:57.771612 30683 webserver.cc:460] Webserver started at http://127.22.45.65:45819/ using document root <none> and password file <none>
I20260805 23:00:57.772372 30683 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:57.772495 30683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:57.772837 30683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:57.776233 30683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "4f56ca3fe02e4470a42c15ab00145474"
format_stamp: "Formatted at 2026-08-05 23:00:57 on dist-test-slave-1vmg"
server_key: "6fa1ae13092b9862de96c885d12d0493"
server_key_iv: "a3af09de8045bf6de34ee954b4d55d5b"
server_key_version: "encryptionkey@0"
I20260805 23:00:57.777185 30683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "4f56ca3fe02e4470a42c15ab00145474"
format_stamp: "Formatted at 2026-08-05 23:00:57 on dist-test-slave-1vmg"
server_key: "6fa1ae13092b9862de96c885d12d0493"
server_key_iv: "a3af09de8045bf6de34ee954b4d55d5b"
server_key_version: "encryptionkey@0"
I20260805 23:00:57.783423 30683 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 23:00:57.787544 30703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:57.789244 30683 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:00:57.789425 30683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "4f56ca3fe02e4470a42c15ab00145474"
format_stamp: "Formatted at 2026-08-05 23:00:57 on dist-test-slave-1vmg"
server_key: "6fa1ae13092b9862de96c885d12d0493"
server_key_iv: "a3af09de8045bf6de34ee954b4d55d5b"
server_key_version: "encryptionkey@0"
I20260805 23:00:57.789645 30683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:57.804867 30683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:57.809413 30683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:57.809731 30683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:57.811017 30683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:57.812522 30683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:57.812606 30683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:57.812714 30683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:57.812779 30683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:57.845817 30683 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:34889
I20260805 23:00:57.845875 30852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:34889 every 8 connection(s)
I20260805 23:00:57.847292 30683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:00:57.850515 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 30683
I20260805 23:00:57.850750 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:00:57.851653 22709 external_mini_cluster.cc:1428] Setting key 458b84392301b248f4bce2affb072eb9
Aug 05 23:00:57 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970857, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:57.871563 30856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:57.850047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:60877 (local address 127.22.45.126:46679)
0805 23:00:57.850495 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:57.850500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:57.852682 (+ 2182us) server_negotiation.cc:407] Connection header received
0805 23:00:57.854965 (+ 2283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:57.854971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:57.855050 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:57.855147 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:57.856961 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:57.857721 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:57.859587 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:57.860046 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:57.860177 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:57.865240 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:57.865246 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:57.865249 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:57.865292 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:57.867983 (+ 2691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:57.868933 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:57.868938 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:57.868940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:57.869089 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:57.869568 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:57.869572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:57.869574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:57.869882 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:57.870024 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:57.870866 (+ 842us) server_negotiation.cc:299] Negotiation successful
0805 23:00:57.871181 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":241,"threads_started":1}
I20260805 23:00:57.872713 30857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:57.850676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46679 (local address 127.22.45.65:60877)
0805 23:00:57.851959 (+ 1283us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:57.852039 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:57.854486 (+ 2447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:57.855458 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:57.855469 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:57.856079 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:57.856744 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:57.856765 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:57.857919 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:57.857923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:57.859388 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:57.859408 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:57.860335 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:57.860343 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:57.860611 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:57.861412 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:57.861438 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:57.864892 (+ 3454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:57.868212 (+ 3320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:57.868223 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:57.868241 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:57.868779 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:57.869207 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:57.869213 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:57.869217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:57.869438 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:57.870018 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:57.870028 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:57.870439 (+ 411us) client_negotiation.cc:769] Sending connection context
0805 23:00:57.870715 (+ 276us) client_negotiation.cc:240] Negotiation successful
0805 23:00:57.871360 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":801,"thread_start_us":446,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:00:57.874562 30853 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46679
I20260805 23:00:57.874894 30853 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:57.875787 30853 heartbeater.cc:511] Master 127.22.45.126:46679 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
I20260805 23:00:57.878360 30606 ts_manager.cc:194] Registered new tserver with Master: 4f56ca3fe02e4470a42c15ab00145474 (127.22.45.65:34889)
I20260805 23:00:57.880555 30606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:60877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:00:57.909770 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46679
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:58.270524 30860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:58.270901 30860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:58.271087 30860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:58.279627 30860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:58.279817 30860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:58.279999 30860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:00:58.290411 30860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:58.291953 30860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:58.293485 30860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:58.307440 30866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:58.307520 30871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:58.307483 30865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:58.308609 30860 server_base.cc:1034] running on GCE node
I20260805 23:00:58.309396 30860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:58.310724 30860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:58.312008 30860 hybrid_clock.cc:648] HybridClock initialized: now 1785970858311960 us; error 49 us; skew 500 ppm
I20260805 23:00:58.312424 30860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:58 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970858, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:58.316196 30860 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:00:58.318032 30860 webserver.cc:460] Webserver started at http://127.22.45.66:39235/ using document root <none> and password file <none>
I20260805 23:00:58.318819 30860 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:58.318987 30860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:58.319342 30860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:58.322681 30860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "9413fc8c3ab243068beb210c0e902d7f"
format_stamp: "Formatted at 2026-08-05 23:00:58 on dist-test-slave-1vmg"
server_key: "0741de11e205d54afc452722b0cfb18c"
server_key_iv: "e89c158c58a0f0a77a493ddf1c2484ba"
server_key_version: "encryptionkey@0"
I20260805 23:00:58.323698 30860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "9413fc8c3ab243068beb210c0e902d7f"
format_stamp: "Formatted at 2026-08-05 23:00:58 on dist-test-slave-1vmg"
server_key: "0741de11e205d54afc452722b0cfb18c"
server_key_iv: "e89c158c58a0f0a77a493ddf1c2484ba"
server_key_version: "encryptionkey@0"
I20260805 23:00:58.336789 30860 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.002s sys 0.005s
I20260805 23:00:58.341816 30881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:58.343848 30860 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260805 23:00:58.344087 30860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "9413fc8c3ab243068beb210c0e902d7f"
format_stamp: "Formatted at 2026-08-05 23:00:58 on dist-test-slave-1vmg"
server_key: "0741de11e205d54afc452722b0cfb18c"
server_key_iv: "e89c158c58a0f0a77a493ddf1c2484ba"
server_key_version: "encryptionkey@0"
I20260805 23:00:58.344379 30860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:58.372745 30860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:58.377573 30860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:58.377892 30860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:58.379041 30860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:58.380558 30860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:58.380635 30860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:58.380755 30860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:58.380807 30860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:58.413843 30860 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:45699
I20260805 23:00:58.413939 31025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:45699 every 8 connection(s)
I20260805 23:00:58.415318 30860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:00:58.417364 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 30860
I20260805 23:00:58.417555 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:00:58.418001 22709 external_mini_cluster.cc:1428] Setting key 2d6bf43bc82fff60d66f0d089ae59ba6
Aug 05 23:00:58 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970858, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:58.439220 31029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:58.418253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:51689 (local address 127.22.45.126:46679)
0805 23:00:58.418750 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:58.418757 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:58.419949 (+ 1192us) server_negotiation.cc:407] Connection header received
0805 23:00:58.421958 (+ 2009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:58.421964 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:58.422052 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:58.422151 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:58.423922 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.424659 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.426332 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.426861 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.427033 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:58.431561 (+ 4528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:58.431569 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:58.431574 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:58.431623 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:58.435047 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:58.436044 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:58.436052 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:58.436055 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:58.436243 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:58.436716 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:58.436721 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:58.436724 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:58.437108 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:58.437281 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:58.438401 (+ 1120us) server_negotiation.cc:299] Negotiation successful
0805 23:00:58.438684 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":496,"threads_started":1}
I20260805 23:00:58.440373 31030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:58.418794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46679 (local address 127.22.45.66:51689)
0805 23:00:58.419761 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:58.419825 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:58.421638 (+ 1813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:58.422428 (+ 790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:58.422438 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:58.423101 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:58.423737 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:58.423756 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.424833 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.424837 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:58.426151 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:58.426167 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.427156 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.427165 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:58.427420 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:58.428256 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:58.428289 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:58.431191 (+ 2902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:58.435262 (+ 4071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:58.435273 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:58.435291 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:58.435854 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:58.436355 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:58.436360 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:58.436362 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:58.436598 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:58.437298 (+ 700us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:58.437306 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:58.437742 (+ 436us) client_negotiation.cc:769] Sending connection context
0805 23:00:58.438244 (+ 502us) client_negotiation.cc:240] Negotiation successful
0805 23:00:58.438902 (+ 658us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":337,"threads_started":1}
I20260805 23:00:58.441933 31026 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46679
I20260805 23:00:58.442273 31026 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:00:58.443143 31026 heartbeater.cc:511] Master 127.22.45.126:46679 requested a full tablet report, sending...
I20260805 23:00:58.444962 30606 ts_manager.cc:194] Registered new tserver with Master: 9413fc8c3ab243068beb210c0e902d7f (127.22.45.66:45699)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
I20260805 23:00:58.446089 30606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:51689
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:00:58.475679 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46679
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40459
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:00:58.836333 31034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:00:58.836836 31034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:00:58.837033 31034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:00:58.845100 31034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:00:58.845327 31034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:00:58.845492 31034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:00:58.856805 31034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40459
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46679
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:00:58.858742 31034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:00:58.860387 31034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:00:58.875527 31039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:58.875607 31040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:00:58.875545 31042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:00:58.876063 31034 server_base.cc:1034] running on GCE node
I20260805 23:00:58.876892 31034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:00:58.877985 31034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:00:58.879240 31034 hybrid_clock.cc:648] HybridClock initialized: now 1785970858879185 us; error 47 us; skew 500 ppm
I20260805 23:00:58.879585 31034 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:00:58 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970858, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:58.883101 31034 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:00:58.884583 30853 heartbeater.cc:503] Master 127.22.45.126:46679 was elected leader, sending a full tablet report...
I20260805 23:00:58.884941 31034 webserver.cc:460] Webserver started at http://127.22.45.67:37073/ using document root <none> and password file <none>
I20260805 23:00:58.885717 31034 fs_manager.cc:359] Metadata directory not provided
I20260805 23:00:58.885838 31034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:00:58.886165 31034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:00:58.889492 31034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "abbe2f5179b54a3c946053a6e3817c71"
format_stamp: "Formatted at 2026-08-05 23:00:58 on dist-test-slave-1vmg"
server_key: "012af422228709338d45d64025c783bc"
server_key_iv: "6765cb6e306424442ca1ac1229eb74c9"
server_key_version: "encryptionkey@0"
I20260805 23:00:58.890323 31034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "abbe2f5179b54a3c946053a6e3817c71"
format_stamp: "Formatted at 2026-08-05 23:00:58 on dist-test-slave-1vmg"
server_key: "012af422228709338d45d64025c783bc"
server_key_iv: "6765cb6e306424442ca1ac1229eb74c9"
server_key_version: "encryptionkey@0"
I20260805 23:00:58.896126 31034 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260805 23:00:58.899978 31050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:58.901928 31034 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:00:58.902132 31034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "abbe2f5179b54a3c946053a6e3817c71"
format_stamp: "Formatted at 2026-08-05 23:00:58 on dist-test-slave-1vmg"
server_key: "012af422228709338d45d64025c783bc"
server_key_iv: "6765cb6e306424442ca1ac1229eb74c9"
server_key_version: "encryptionkey@0"
I20260805 23:00:58.902384 31034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:00:58.931833 31034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:00:58.936071 31034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:00:58.936365 31034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:00:58.937353 31034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:00:58.938769 31034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:00:58.938843 31034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:00:58.938964 31034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:00:58.939020 31034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260805 23:00:58.971518 31034 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:37695
I20260805 23:00:58.971573 31203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:37695 every 8 connection(s)
I20260805 23:00:58.973033 31034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:00:58.982333 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 31034
I20260805 23:00:58.982498 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:00:58.983037 22709 external_mini_cluster.cc:1428] Setting key 2b00de0808ad2319a76ffc6a0feda996
Aug 05 23:00:58 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970858, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:00:58.993805 31207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:58.975947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:33887 (local address 127.22.45.126:46679)
0805 23:00:58.976411 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:58.976415 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:58.977361 (+ 946us) server_negotiation.cc:407] Connection header received
0805 23:00:58.979272 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:58.979278 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:58.979381 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:58.979481 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:58.981134 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.981956 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.983744 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.984159 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.984274 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:58.988049 (+ 3775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:58.988054 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:58.988057 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:58.988096 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:58.990645 (+ 2549us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:58.991554 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:58.991558 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:58.991560 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:58.991704 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:58.992097 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:58.992100 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:58.992102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:58.992381 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:58.992504 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:58.993193 (+ 689us) server_negotiation.cc:299] Negotiation successful
0805 23:00:58.993384 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":240,"threads_started":1}
I20260805 23:00:58.994887 31209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:58.976438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46679 (local address 127.22.45.67:33887)
0805 23:00:58.977198 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0805 23:00:58.977249 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 23:00:58.978991 (+ 1742us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:00:58.979758 (+ 767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:00:58.979767 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:00:58.980356 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:00:58.980953 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:58.980972 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.982118 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.982123 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:58.983592 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:00:58.983606 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:00:58.984389 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:00:58.984396 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:00:58.984630 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:58.985366 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:00:58.985391 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:00:58.987807 (+ 2416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:00:58.990803 (+ 2996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:58.990812 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:58.990829 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:58.991418 (+ 589us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:58.991793 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:00:58.991797 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:00:58.991799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:00:58.992011 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:00:58.992475 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:00:58.992482 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:00:58.992864 (+ 382us) client_negotiation.cc:769] Sending connection context
0805 23:00:58.993107 (+ 243us) client_negotiation.cc:240] Negotiation successful
0805 23:00:58.993618 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":299,"threads_started":1}
I20260805 23:00:58.996447 31204 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46679
I20260805 23:00:58.996827 31204 heartbeater.cc:464] Registering TS with master...
I20260805 23:00:58.997781 31204 heartbeater.cc:511] Master 127.22.45.126:46679 requested a full tablet report, sending...
I20260805 23:00:58.999451 30606 ts_manager.cc:194] Registered new tserver with Master: abbe2f5179b54a3c946053a6e3817c71 (127.22.45.67:37695)
I20260805 23:00:59.000283 30606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:33887
I20260805 23:00:59.011442 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/test-admin.keytab.
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:59.044283 22709 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260805 23:00:59.050187 31217 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:59.047646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34122 (local address 127.22.45.65:34889)
0805 23:00:59.048344 (+ 698us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.048353 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.048384 (+ 31us) server_negotiation.cc:407] Connection header received
0805 23:00:59.048457 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.048465 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.048696 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.048855 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.049770 (+ 915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34122: BlockingRecv error: recv got EOF from 127.0.0.1:34122 (error 108)
Metrics: {"server-negotiator.queue_time_us":545,"thread_start_us":404,"threads_started":1}
W20260805 23:00:59.050786 22709 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc)
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:59.052724 22709 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:59.054404 22709 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:59.072422 31217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:59.056711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34126 (local address 127.22.45.65:34889)
0805 23:00:59.056920 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.056926 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.057016 (+ 90us) server_negotiation.cc:407] Connection header received
0805 23:00:59.057198 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.057202 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.057268 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.057348 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.058471 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.059595 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.060954 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.061594 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.061705 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:59.065800 (+ 4095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:59.065817 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:59.065835 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:59.065889 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:59.069359 (+ 3470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.070266 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.070275 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.070277 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.070431 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.070803 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.070807 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.070809 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.071291 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:59.071549 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:59.071820 (+ 271us) server_negotiation.cc:299] Negotiation successful
0805 23:00:59.072093 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260805 23:00:59.079114 31217 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:59.077104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34136 (local address 127.22.45.65:34889)
0805 23:00:59.077335 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.077341 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.077499 (+ 158us) server_negotiation.cc:407] Connection header received
0805 23:00:59.077695 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.077699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.077782 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.077878 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.078819 (+ 941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34136: BlockingRecv error: recv got EOF from 127.0.0.1:34136 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260805 23:00:59.079401 22709 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc' of type FILE
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:59.081038 22709 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:59.082561 22709 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:59.098773 31217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:59.084379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34140 (local address 127.22.45.65:34889)
0805 23:00:59.084636 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.084643 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.084884 (+ 241us) server_negotiation.cc:407] Connection header received
0805 23:00:59.085077 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.085081 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.085151 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.085243 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.086333 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.087124 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.088374 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.088844 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.088963 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:59.093131 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:59.093137 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:59.093141 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:59.093208 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:59.096054 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.096902 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.096907 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.096909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.097065 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.097521 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.097525 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.097527 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.097840 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:59.098054 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:59.098346 (+ 292us) server_negotiation.cc:299] Negotiation successful
0805 23:00:59.098534 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260805 23:00:59.103586 31217 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:00:59.101629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34156 (local address 127.22.45.65:34889)
0805 23:00:59.101777 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.101781 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.102210 (+ 429us) server_negotiation.cc:407] Connection header received
0805 23:00:59.102374 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.102379 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.102451 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.102536 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.103329 (+ 793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34156: BlockingRecv error: recv got EOF from 127.0.0.1:34156 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260805 23:00:59.103930 22709 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1785970804553337-22709-0/krb5kdc/krb5cc' of type FILE
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:59.105545 22709 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:00:59.106992 22709 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:00:59.122151 31217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:59.108544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34166 (local address 127.22.45.65:34889)
0805 23:00:59.108781 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.108787 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.108902 (+ 115us) server_negotiation.cc:407] Connection header received
0805 23:00:59.109049 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.109052 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.109148 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.109237 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.110186 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.111002 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.112205 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.112645 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.112752 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:59.116630 (+ 3878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:59.116636 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:59.116639 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:59.116686 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:59.119593 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.120351 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.120355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.120357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.120536 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.120842 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.120846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.120847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.121154 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:59.121407 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:59.121597 (+ 190us) server_negotiation.cc:299] Negotiation successful
0805 23:00:59.121791 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 23:00:59.123871 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 30683
I20260805 23:00:59.137720 31217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:59.124673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34178 (local address 127.22.45.65:34889)
0805 23:00:59.124913 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.124918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.125243 (+ 325us) server_negotiation.cc:407] Connection header received
0805 23:00:59.125409 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.125414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.125480 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.125572 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.126594 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.127459 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.128727 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.129244 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.129353 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:59.131758 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:59.131765 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:59.131769 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:59.131837 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:59.134827 (+ 2990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.135757 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.135762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.135764 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.135937 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.136325 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.136329 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.136332 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.136707 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:59.136948 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:59.137242 (+ 294us) server_negotiation.cc:299] Negotiation successful
0805 23:00:59.137438 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260805 23:00:59.138458 30847 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:59.222684 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 30683
I20260805 23:00:59.246367 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 30860
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:00:59.263253 31235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:59.247366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55744 (local address 127.22.45.66:45699)
0805 23:00:59.247908 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.247916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.247942 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:00:59.248003 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.248009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.248231 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.248363 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.249460 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.250581 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.252081 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.252666 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.252789 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:59.257022 (+ 4233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:59.257042 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:59.257059 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:59.257134 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:59.260304 (+ 3170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.261179 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.261187 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.261189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.261343 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.261664 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.261667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.261669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.262076 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:59.262342 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:59.262616 (+ 274us) server_negotiation.cc:299] Negotiation successful
0805 23:00:59.262878 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":277,"threads_started":1}
I20260805 23:00:59.264706 31020 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:59.352649 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 30860
I20260805 23:00:59.375218 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 31034
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[30545](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:00:59.392418 31238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:00:59.376251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51020 (local address 127.22.45.67:37695)
0805 23:00:59.376937 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0805 23:00:59.376945 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:00:59.376975 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:00:59.377035 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:00:59.377041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:00:59.377265 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:00:59.377423 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:00:59.378591 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.379881 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.381202 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:00:59.381805 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:00:59.381930 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:00:59.386363 (+ 4433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:00:59.386381 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:00:59.386398 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:00:59.386441 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:00:59.389357 (+ 2916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.390175 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.390183 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.390186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.390329 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:00:59.390753 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:00:59.390757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:00:59.390759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:00:59.391197 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:00:59.391521 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0805 23:00:59.391821 (+ 300us) server_negotiation.cc:299] Negotiation successful
0805 23:00:59.392103 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":344,"threads_started":1}
I20260805 23:00:59.393771 31199 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:59.478845 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 31034
I20260805 23:00:59.501430 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 30563
I20260805 23:00:59.502727 30645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:00:59.619163 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 30563
2026-08-05T23:00:59Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4429 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[31243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[31243](info): set up 2 sockets
Aug 05 23:00:59 dist-test-slave-1vmg krb5kdc[31243](info): commencing operation
krb5kdc: starting...
W20260805 23:01:00.838487 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.160s user 0.001s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:01:00 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:01:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:01Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab.
Entry for principal oryx/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab.
I20260805 23:01:01.094304 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39013
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab
--principal=oryx/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39013
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:01.453806 31262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:01.454207 31262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:01.454355 31262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:01.461944 31262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:01.462103 31262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:01.462182 31262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:01.462270 31262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:01.462338 31262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:01.473471 31262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39013
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab
--principal=oryx/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39013
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:01.475155 31262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:01.476576 31262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:01.489336 31274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:01.489387 31271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:01.489705 31270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:01.490123 31262 server_base.cc:1034] running on GCE node
I20260805 23:01:01.491176 31262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:01.493062 31262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:01.494361 31262 hybrid_clock.cc:648] HybridClock initialized: now 1785970861494310 us; error 40 us; skew 500 ppm
I20260805 23:01:01.494825 31262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:01 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970861, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:01.498486 31262 init.cc:377] Logged in from keytab as oryx/127.22.45.126@KRBTEST.COM (short username oryx)
I20260805 23:01:01.500340 31262 webserver.cc:460] Webserver started at http://127.22.45.126:32785/ using document root <none> and password file <none>
I20260805 23:01:01.501153 31262 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:01.501283 31262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:01.501616 31262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:01.505029 31262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "c3ec687b45824a42bf59b08238d53e0b"
format_stamp: "Formatted at 2026-08-05 23:01:01 on dist-test-slave-1vmg"
server_key: "52c61b9017796a899466b04db2c0f59b"
server_key_iv: "5fdf380a46f996966bcdda59209cbdd4"
server_key_version: "encryptionkey@0"
I20260805 23:01:01.505957 31262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "c3ec687b45824a42bf59b08238d53e0b"
format_stamp: "Formatted at 2026-08-05 23:01:01 on dist-test-slave-1vmg"
server_key: "52c61b9017796a899466b04db2c0f59b"
server_key_iv: "5fdf380a46f996966bcdda59209cbdd4"
server_key_version: "encryptionkey@0"
I20260805 23:01:01.512790 31262 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:01:01.517980 31281 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:01.519881 31262 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:01:01.520148 31262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "c3ec687b45824a42bf59b08238d53e0b"
format_stamp: "Formatted at 2026-08-05 23:01:01 on dist-test-slave-1vmg"
server_key: "52c61b9017796a899466b04db2c0f59b"
server_key_iv: "5fdf380a46f996966bcdda59209cbdd4"
server_key_version: "encryptionkey@0"
I20260805 23:01:01.520371 31262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:01.537434 31262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:01.542276 31262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:01.542557 31262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:01.562785 31262 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:39013
I20260805 23:01:01.562806 31359 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:39013 every 8 connection(s)
I20260805 23:01:01.564548 31262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:01:01.568914 31360 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:01.571704 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 31262
I20260805 23:01:01.571946 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:01:01.572822 22709 external_mini_cluster.cc:1428] Setting key 78ec31ba3d5340a3be4c9a6798eadfb1
I20260805 23:01:01.583256 31360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: Bootstrap starting.
I20260805 23:01:01.587682 31360 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:01.589155 31360 log.cc:824] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: Log is configured to *not* fsync() on all Append() calls
Aug 05 23:01:01 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:01.592777 31360 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: No bootstrap required, opened a new log
I20260805 23:01:01.599148 31363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:01.575312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57872 (local address 127.22.45.126:39013)
0805 23:01:01.576213 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:01.576226 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:01.576271 (+ 45us) server_negotiation.cc:407] Connection header received
0805 23:01:01.578192 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:01.578220 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:01.578716 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:01.579212 (+ 496us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:01.581226 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:01.582701 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:01.584633 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:01.585453 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:01.585639 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:01.590640 (+ 5001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:01.590650 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:01.590671 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:01.590718 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:01.594064 (+ 3346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:01.595026 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:01.595036 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:01.595044 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:01.595267 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:01.595707 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:01.595711 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:01.595713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:01.596373 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:01.596795 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:01.597392 (+ 597us) server_negotiation.cc:299] Negotiation successful
0805 23:01:01.597879 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":417,"threads_started":1}
I20260805 23:01:01.601663 31360 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } }
I20260805 23:01:01.602090 31360 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:01.602210 31360 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3ec687b45824a42bf59b08238d53e0b, State: Initialized, Role: FOLLOWER
I20260805 23:01:01.602898 31360 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } }
I20260805 23:01:01.603228 31360 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:01:01.603365 31360 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:01:01.603541 31360 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:01.606215 31360 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } }
I20260805 23:01:01.606804 31360 leader_election.cc:302] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3ec687b45824a42bf59b08238d53e0b; no voters:
I20260805 23:01:01.607481 31360 leader_election.cc:288] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:01:01.607658 31366 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:01.608350 31366 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 1 LEADER]: Becoming Leader. State: Replica: c3ec687b45824a42bf59b08238d53e0b, State: Running, Role: LEADER
I20260805 23:01:01.609040 31366 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } }
I20260805 23:01:01.609846 31360 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:01.612269 31369 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ec687b45824a42bf59b08238d53e0b. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } }
I20260805 23:01:01.612337 31368 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } }
I20260805 23:01:01.612870 31369 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:01.612898 31368 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:01.614748 31374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:01.626998 31374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:01.635733 31374 catalog_manager.cc:1347] Generated new cluster ID: 7f0887d5ddcd4014a6505c81e0925320
I20260805 23:01:01.635878 31374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:01.650863 31374 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:01:01.652315 31374 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:01.669139 31374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: Generated new TSK 0
I20260805 23:01:01.670506 31374 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab.
Entry for principal oryx/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab.
I20260805 23:01:01.743162 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39013
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab
--principal=oryx/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:02.102620 31391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:02.102995 31391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:02.103127 31391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:02.111121 31391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:02.111258 31391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:02.111415 31391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:02.122124 31391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab
--principal=oryx/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39013
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:02.123690 31391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:02.125451 31391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:02.141273 31399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:02.141220 31402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:02.141297 31398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:02.144526 31391 server_base.cc:1034] running on GCE node
I20260805 23:01:02.145294 31391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:02.146433 31391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:02.147672 31391 hybrid_clock.cc:648] HybridClock initialized: now 1785970862147620 us; error 56 us; skew 500 ppm
I20260805 23:01:02.148073 31391 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:02 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970862, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:02.156395 31391 init.cc:377] Logged in from keytab as oryx/127.22.45.65@KRBTEST.COM (short username oryx)
I20260805 23:01:02.158262 31391 webserver.cc:460] Webserver started at http://127.22.45.65:39047/ using document root <none> and password file <none>
I20260805 23:01:02.159160 31391 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:02.159307 31391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:02.159631 31391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:02.162871 31391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "1fc6712346d34d52ac512258e82813d0"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "2718e9f11045b861ef5cc2315c1a1dfd"
server_key_iv: "10d3a57306644242063844edd80b431d"
server_key_version: "encryptionkey@0"
I20260805 23:01:02.163839 31391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "1fc6712346d34d52ac512258e82813d0"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "2718e9f11045b861ef5cc2315c1a1dfd"
server_key_iv: "10d3a57306644242063844edd80b431d"
server_key_version: "encryptionkey@0"
I20260805 23:01:02.169476 31391 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260805 23:01:02.173514 31410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:02.175071 31391 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:01:02.175261 31391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "1fc6712346d34d52ac512258e82813d0"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "2718e9f11045b861ef5cc2315c1a1dfd"
server_key_iv: "10d3a57306644242063844edd80b431d"
server_key_version: "encryptionkey@0"
I20260805 23:01:02.175474 31391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:02.188413 31391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:02.192840 31391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:02.193148 31391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:02.194235 31391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:02.195731 31391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:02.195815 31391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:02.195943 31391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:02.195999 31391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:02.228405 31391 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:33525
I20260805 23:01:02.228441 31565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:33525 every 8 connection(s)
I20260805 23:01:02.229859 31391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:02.240103 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 31391
I20260805 23:01:02.240311 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:01:02.240967 22709 external_mini_cluster.cc:1428] Setting key 0d32c3db3a6f924bc576e81b763037d7
Aug 05 23:01:02 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970862, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:02.253151 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:02.232608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:44567 (local address 127.22.45.126:39013)
0805 23:01:02.233094 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:02.233099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:02.234110 (+ 1011us) server_negotiation.cc:407] Connection header received
0805 23:01:02.236028 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:02.236033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:02.236114 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:02.236239 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:02.237944 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.238721 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.240690 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.241141 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.241289 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:02.245877 (+ 4588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:02.245883 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:02.245887 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:02.245926 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:02.248747 (+ 2821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:02.249892 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:02.249896 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:02.249898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:02.250048 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:02.250633 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:02.250638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:02.250640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:02.251047 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:02.251186 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:02.252464 (+ 1278us) server_negotiation.cc:299] Negotiation successful
0805 23:01:02.252763 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":227,"threads_started":1}
I20260805 23:01:02.254455 31569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:02.233197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.65:44567)
0805 23:01:02.233935 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:02.233974 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:02.235724 (+ 1750us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:02.236452 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:02.236460 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:02.237062 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:02.237708 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:02.237729 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.239013 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.239017 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:02.240490 (+ 1473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:02.240506 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.241415 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.241422 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:02.241683 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:02.242463 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:02.242496 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:02.245559 (+ 3063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:02.248970 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:02.248983 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:02.249005 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:02.249747 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:02.250158 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:02.250163 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:02.250165 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:02.250460 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:02.251191 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:02.251201 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:02.251716 (+ 515us) client_negotiation.cc:769] Sending connection context
0805 23:01:02.252222 (+ 506us) client_negotiation.cc:240] Negotiation successful
0805 23:01:02.252919 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":270,"threads_started":1}
I20260805 23:01:02.256748 31566 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39013
I20260805 23:01:02.257375 31566 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:02.258425 31566 heartbeater.cc:511] Master 127.22.45.126:39013 requested a full tablet report, sending...
I20260805 23:01:02.260983 31303 ts_manager.cc:194] Registered new tserver with Master: 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525)
I20260805 23:01:02.262651 31303 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:44567
WARNING: no policy specified for oryx/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab.
Entry for principal oryx/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab.
I20260805 23:01:02.299125 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39013
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab
--principal=oryx/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:02.657665 31572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:02.658049 31572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:02.658200 31572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:02.666425 31572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:02.666615 31572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:02.666791 31572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:02.677644 31572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab
--principal=oryx/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39013
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:02.679235 31572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:02.680804 31572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:02.695627 31579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:02.695525 31582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:02.695598 31578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:02.696874 31572 server_base.cc:1034] running on GCE node
I20260805 23:01:02.697641 31572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:02.698796 31572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:02.700120 31572 hybrid_clock.cc:648] HybridClock initialized: now 1785970862700064 us; error 58 us; skew 500 ppm
I20260805 23:01:02.700511 31572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:02 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970862, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:02.704197 31572 init.cc:377] Logged in from keytab as oryx/127.22.45.66@KRBTEST.COM (short username oryx)
I20260805 23:01:02.705930 31572 webserver.cc:460] Webserver started at http://127.22.45.66:42163/ using document root <none> and password file <none>
I20260805 23:01:02.706737 31572 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:02.706881 31572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:02.707262 31572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:02.710647 31572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "cbca29ee5127477a8448fa55c04e180c"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "eb43089943da8084d06c7697902de8ef"
server_key_iv: "a9802102b3cfd735e95c611978358495"
server_key_version: "encryptionkey@0"
I20260805 23:01:02.711687 31572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "cbca29ee5127477a8448fa55c04e180c"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "eb43089943da8084d06c7697902de8ef"
server_key_iv: "a9802102b3cfd735e95c611978358495"
server_key_version: "encryptionkey@0"
I20260805 23:01:02.717784 31572 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:01:02.721602 31589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:02.723125 31572 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:01:02.723322 31572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "cbca29ee5127477a8448fa55c04e180c"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "eb43089943da8084d06c7697902de8ef"
server_key_iv: "a9802102b3cfd735e95c611978358495"
server_key_version: "encryptionkey@0"
I20260805 23:01:02.723536 31572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:02.737375 31572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:02.742169 31572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:02.742513 31572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:02.743695 31572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:02.745272 31572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:02.745360 31572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:02.745496 31572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:02.745560 31572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:02.778993 31572 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:36051
I20260805 23:01:02.779057 31742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:36051 every 8 connection(s)
I20260805 23:01:02.780471 31572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:02.786326 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 31572
I20260805 23:01:02.786496 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:01:02.786998 22709 external_mini_cluster.cc:1428] Setting key c16922b369f0aaaefa465cbdba07c2c5
Aug 05 23:01:02 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970862, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:02.802735 31747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:02.783311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:41377 (local address 127.22.45.126:39013)
0805 23:01:02.783774 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:02.783779 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:02.784828 (+ 1049us) server_negotiation.cc:407] Connection header received
0805 23:01:02.786787 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:02.786793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:02.786890 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:02.787035 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:02.788983 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.789735 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.791673 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.792118 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.792239 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:02.796214 (+ 3975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:02.796220 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:02.796223 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:02.796262 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:02.799221 (+ 2959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:02.800143 (+ 922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:02.800148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:02.800151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:02.800310 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:02.800796 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:02.800801 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:02.800803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:02.801103 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:02.801250 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:02.802043 (+ 793us) server_negotiation.cc:299] Negotiation successful
0805 23:01:02.802317 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":231,"threads_started":1}
I20260805 23:01:02.803882 31748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:02.783887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.66:41377)
0805 23:01:02.784636 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:02.784677 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:02.786453 (+ 1776us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:02.787319 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:02.787328 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:02.787901 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:02.788790 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:02.788820 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.790011 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.790035 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:02.791492 (+ 1457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:02.791507 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:02.792378 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:02.792386 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:02.792634 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:02.793419 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:02.793445 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:02.795899 (+ 2454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:02.799428 (+ 3529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:02.799438 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:02.799456 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:02.799996 (+ 540us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:02.800433 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:02.800439 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:02.800442 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:02.800671 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:02.801248 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:02.801257 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:02.801660 (+ 403us) client_negotiation.cc:769] Sending connection context
0805 23:01:02.801928 (+ 268us) client_negotiation.cc:240] Negotiation successful
0805 23:01:02.802568 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":291,"threads_started":1}
I20260805 23:01:02.805522 31743 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39013
I20260805 23:01:02.805950 31743 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:02.807096 31743 heartbeater.cc:511] Master 127.22.45.126:39013 requested a full tablet report, sending...
I20260805 23:01:02.808996 31303 ts_manager.cc:194] Registered new tserver with Master: cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051)
I20260805 23:01:02.809897 31303 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:41377
WARNING: no policy specified for oryx/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab.
Entry for principal oryx/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab.
I20260805 23:01:02.842675 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39013
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab
--principal=oryx/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:03.199447 31753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:03.199839 31753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:03.199970 31753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:03.207850 31753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:03.207996 31753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:03.208137 31753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:03.219149 31753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab
--principal=oryx/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39013
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:03.220780 31753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:03.222631 31753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:03.239965 31761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:03.240077 31768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:03.239985 31764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:03.241477 31753 server_base.cc:1034] running on GCE node
I20260805 23:01:03.242235 31753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:03.243444 31753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:03.244719 31753 hybrid_clock.cc:648] HybridClock initialized: now 1785970863244649 us; error 64 us; skew 500 ppm
I20260805 23:01:03.245121 31753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:03 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970863, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:03.248833 31753 init.cc:377] Logged in from keytab as oryx/127.22.45.67@KRBTEST.COM (short username oryx)
I20260805 23:01:03.250721 31753 webserver.cc:460] Webserver started at http://127.22.45.67:39175/ using document root <none> and password file <none>
I20260805 23:01:03.251587 31753 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:03.251727 31753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:03.252071 31753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:03.255661 31753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "363a540217f5466f9606df810a3ba9ec"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "ee26646c287224a634cdcd8c67732325"
server_key_iv: "1bd2daa7a633db69725423ff316e7903"
server_key_version: "encryptionkey@0"
I20260805 23:01:03.256953 31753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "363a540217f5466f9606df810a3ba9ec"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "ee26646c287224a634cdcd8c67732325"
server_key_iv: "1bd2daa7a633db69725423ff316e7903"
server_key_version: "encryptionkey@0"
I20260805 23:01:03.263723 31753 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 23:01:03.266191 31566 heartbeater.cc:503] Master 127.22.45.126:39013 was elected leader, sending a full tablet report...
I20260805 23:01:03.268138 31776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:03.269989 31753 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:01:03.270195 31753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "363a540217f5466f9606df810a3ba9ec"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "ee26646c287224a634cdcd8c67732325"
server_key_iv: "1bd2daa7a633db69725423ff316e7903"
server_key_version: "encryptionkey@0"
I20260805 23:01:03.270433 31753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:03.293161 31753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:03.298195 31753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:03.298563 31753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:03.299863 31753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:03.301573 31753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:03.301664 31753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:03.301782 31753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:03.301833 31753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:03.340412 31753 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46187
I20260805 23:01:03.340459 31929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46187 every 8 connection(s)
I20260805 23:01:03.341833 31753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:03.350247 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 31753
I20260805 23:01:03.350433 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:01:03.350965 22709 external_mini_cluster.cc:1428] Setting key c40c4e4602580e8c1ee7e7a64d59090f
Aug 05 23:01:03 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970863, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:03.366955 31933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.344803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:35429 (local address 127.22.45.126:39013)
0805 23:01:03.345341 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:03.345347 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:03.346974 (+ 1627us) server_negotiation.cc:407] Connection header received
0805 23:01:03.349554 (+ 2580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:03.349560 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:03.349673 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:03.349808 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:03.351808 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.352904 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.355098 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.355531 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.355640 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:03.359490 (+ 3850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:03.359496 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:03.359500 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:03.359555 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:03.362485 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.363460 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.363465 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.363467 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.363618 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.364216 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.364222 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.364225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.364585 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:03.364782 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:03.366244 (+ 1462us) server_negotiation.cc:299] Negotiation successful
0805 23:01:03.366536 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":286,"threads_started":1}
I20260805 23:01:03.368094 31934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.345385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:35429)
0805 23:01:03.346650 (+ 1265us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:03.346733 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:03.349131 (+ 2398us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:03.350123 (+ 992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:03.350134 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:03.350814 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:03.351614 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:03.351636 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.353111 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.353115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:03.354881 (+ 1766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:03.354898 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.355736 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.355741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:03.355956 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:03.356689 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:03.356716 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:03.359165 (+ 2449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:03.362692 (+ 3527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:03.362702 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:03.362720 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:03.363321 (+ 601us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:03.363765 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:03.363769 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:03.363772 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:03.364027 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:03.364889 (+ 862us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:03.364899 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:03.365696 (+ 797us) client_negotiation.cc:769] Sending connection context
0805 23:01:03.366060 (+ 364us) client_negotiation.cc:240] Negotiation successful
0805 23:01:03.366635 (+ 575us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"thread_start_us":558,"threads_started":1}
I20260805 23:01:03.369618 31931 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39013
I20260805 23:01:03.369913 31931 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:03.370666 31931 heartbeater.cc:511] Master 127.22.45.126:39013 requested a full tablet report, sending...
I20260805 23:01:03.372210 31303 ts_manager.cc:194] Registered new tserver with Master: 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187)
I20260805 23:01:03.373023 31303 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:35429
I20260805 23:01:03.380394 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.125.keytab.
Entry for principal oryx/127.22.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.125.keytab.
I20260805 23:01:03.434689 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:44967
--webserver_interface=127.22.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.125.keytab
--principal=oryx/127.22.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39013,127.22.45.125:44967
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:03.788666 31942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:03.789009 31942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:03.789121 31942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:03.796641 31942 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:03.796788 31942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:03.796839 31942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:03.796922 31942 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:03.796976 31942 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:03.807346 31942 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39013,127.22.45.125:44967
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.125.keytab
--principal=oryx/127.22.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:44967
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
W20260805 23:01:03.807773 31942 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.22.45.126:39013,127.22.45.125:44967'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260805 23:01:03.808876 31942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:03.810209 31942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 23:01:03.813144 31743 heartbeater.cc:503] Master 127.22.45.126:39013 was elected leader, sending a full tablet report...
W20260805 23:01:03.823405 31950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:03.823525 31952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:03.823482 31949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:03.824662 31942 server_base.cc:1034] running on GCE node
I20260805 23:01:03.825552 31942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:03.827185 31942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:03.828415 31942 hybrid_clock.cc:648] HybridClock initialized: now 1785970863828337 us; error 66 us; skew 500 ppm
I20260805 23:01:03.828810 31942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:03 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970863, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:03.832238 31942 init.cc:377] Logged in from keytab as oryx/127.22.45.125@KRBTEST.COM (short username oryx)
I20260805 23:01:03.835273 31942 webserver.cc:460] Webserver started at http://127.22.45.125:45209/ using document root <none> and password file <none>
I20260805 23:01:03.836072 31942 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:03.836179 31942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:03.836511 31942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:03.839958 31942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/instance:
uuid: "990bc9188b314b7094f785f00dfb708f"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "e734875043fc86a345118d351efea1b4"
server_key_iv: "a7c5e22aafc2c7dc516bcecc15dc050f"
server_key_version: "encryptionkey@0"
I20260805 23:01:03.840837 31942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal/instance:
uuid: "990bc9188b314b7094f785f00dfb708f"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "e734875043fc86a345118d351efea1b4"
server_key_iv: "a7c5e22aafc2c7dc516bcecc15dc050f"
server_key_version: "encryptionkey@0"
I20260805 23:01:03.847201 31942 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:01:03.851449 31959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:03.853084 31942 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:01:03.853302 31942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
uuid: "990bc9188b314b7094f785f00dfb708f"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "e734875043fc86a345118d351efea1b4"
server_key_iv: "a7c5e22aafc2c7dc516bcecc15dc050f"
server_key_version: "encryptionkey@0"
I20260805 23:01:03.853538 31942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:03.872586 31942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:03.878556 31942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:03.878850 31942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:03.897214 32037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.125:44967 every 8 connection(s)
I20260805 23:01:03.897209 31942 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.125:44967
I20260805 23:01:03.898895 31942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
I20260805 23:01:03.899832 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 31942
I20260805 23:01:03.904870 32038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:03.915337 32038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:01:03 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.125@KRBTEST.COM
I20260805 23:01:03.928824 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.902648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53784 (local address 127.22.45.125:44967)
0805 23:01:03.903505 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:03.903518 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:03.903571 (+ 53us) server_negotiation.cc:407] Connection header received
0805 23:01:03.905623 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:03.905667 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:03.906406 (+ 739us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:03.907122 (+ 716us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:03.909447 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.911312 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.912821 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.913665 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.913879 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:03.918595 (+ 4716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:03.918606 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:03.918625 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:03.918682 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:03.922869 (+ 4187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.924171 (+ 1302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.924183 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.924193 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.924626 (+ 433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.925362 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.925367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.925369 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.926055 (+ 686us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:03.926394 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:03.927005 (+ 611us) server_negotiation.cc:299] Negotiation successful
0805 23:01:03.927493 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":394,"threads_started":1}
Aug 05 23:01:03 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970863, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.125@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:03.936455 32043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.919817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57880 (local address 127.22.45.126:39013)
0805 23:01:03.920295 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:03.920300 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:03.921116 (+ 816us) server_negotiation.cc:407] Connection header received
0805 23:01:03.921363 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:03.921369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:03.921457 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:03.921559 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:03.922907 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.924075 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.925804 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.926338 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.926464 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:03.930492 (+ 4028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:03.930499 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:03.930503 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:03.930553 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:03.933536 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.934410 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.934415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.934418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.934567 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.935043 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.935047 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.935049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.935410 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:03.935543 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:03.935989 (+ 446us) server_negotiation.cc:299] Negotiation successful
0805 23:01:03.936177 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":256,"threads_started":1}
I20260805 23:01:03.936556 32044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.919853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:57880)
0805 23:01:03.920925 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:03.920979 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:03.921202 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:03.921643 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:03.921651 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:03.922394 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:03.922727 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:03.922738 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.924261 (+ 1523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.924267 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:03.925630 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:03.925645 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.926537 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.926543 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:03.926757 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:03.927526 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:03.927550 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:03.930217 (+ 2667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:03.933695 (+ 3478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:03.933706 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:03.933711 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:03.934269 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:03.934709 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:03.934713 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:03.934715 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:03.934903 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:03.935549 (+ 646us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:03.935556 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:03.935736 (+ 180us) client_negotiation.cc:769] Sending connection context
0805 23:01:03.935915 (+ 179us) client_negotiation.cc:240] Negotiation successful
0805 23:01:03.936242 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":579,"threads_started":1}
I20260805 23:01:03.938650 32038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:01:03 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970863, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.125@KRBTEST.COM for oryx/127.22.45.125@KRBTEST.COM
I20260805 23:01:03.951553 32044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.939539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.0.0.1:53788)
0805 23:01:03.939736 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:03.939753 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:03.939866 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:03.940150 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:03.940154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:03.940559 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:03.940704 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:03.940713 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.941709 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.941712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:03.942591 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:03.942602 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.943375 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.943380 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:03.943580 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:03.944179 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:03.944197 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:03.946358 (+ 2161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:03.949162 (+ 2804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:03.949168 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:03.949172 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:03.949551 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:03.949912 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:03.949917 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:03.949921 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:03.950056 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:03.950576 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:03.950580 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:03.950728 (+ 148us) client_negotiation.cc:769] Sending connection context
0805 23:01:03.950847 (+ 119us) client_negotiation.cc:240] Negotiation successful
0805 23:01:03.951198 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260805 23:01:03.951754 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.939756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53788 (local address 127.22.45.125:44967)
0805 23:01:03.939904 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:03.939909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:03.939927 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:01:03.939971 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:03.939976 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:03.940034 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:03.940116 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:03.940841 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.941561 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.942731 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:03.943229 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:03.943344 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:03.946554 (+ 3210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:03.946558 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:03.946562 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:03.946592 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:03.949016 (+ 2424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.949662 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.949668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.949670 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.949807 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:03.950156 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:03.950160 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:03.950162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:03.950455 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:03.950600 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:03.950985 (+ 385us) server_negotiation.cc:299] Negotiation successful
0805 23:01:03.951373 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":153,"server-negotiator.queue_time_us":50}
I20260805 23:01:03.956939 32038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Bootstrap starting.
I20260805 23:01:03.960485 32038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:03.961632 32038 log.cc:824] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:03.964520 32038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: No bootstrap required, opened a new log
I20260805 23:01:03.971891 32038 raft_consensus.cc:348] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } }
I20260805 23:01:03.972286 32038 raft_consensus.cc:374] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:03.972357 32038 raft_consensus.cc:729] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 990bc9188b314b7094f785f00dfb708f, State: Initialized, Role: FOLLOWER
I20260805 23:01:03.972978 32038 consensus_queue.cc:260] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } }
I20260805 23:01:03.973956 32047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } } }
I20260805 23:01:03.974304 32047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:01:03.975231 32038 sys_catalog.cc:564] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: configured and running, proceeding with master startup.
W20260805 23:01:03.985831 32059 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:01:03.986145 32059 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 23:01:03.988955 31942 master_runner.cc:428] Detected that this master 990bc9188b314b7094f785f00dfb708f is joining an existing cluster
I20260805 23:01:03.989063 31942 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.45.125:44967
WARNING: no policy specified for oryx/127.22.45.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.124@KRBTEST.COM" created.
I20260805 23:01:04.021729 32043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.994066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57896 (local address 127.22.45.126:39013)
0805 23:01:03.994263 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:03.994269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.003695 (+ 9426us) server_negotiation.cc:407] Connection header received
0805 23:01:04.004093 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.004101 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.004237 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.004376 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.006304 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.007617 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.010147 (+ 2530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.010727 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.010866 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.013868 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.013877 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.013881 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.013930 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.018055 (+ 4125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.019033 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.019040 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.019044 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.019231 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.019797 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.019803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.019807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.020218 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.020385 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.021081 (+ 696us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.021367 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 23:01:04.021862 32067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.993639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:57896)
0805 23:01:04.003496 (+ 9857us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.003527 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.003856 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.004639 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.004645 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.005509 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.006023 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.006042 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.007881 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.007888 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.009899 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.009926 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.011229 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.011255 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.011498 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.012237 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.012269 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.013583 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.018245 (+ 4662us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.018251 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.018255 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.018813 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.019405 (+ 592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.019409 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.019413 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.019606 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.020478 (+ 872us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.020482 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.020760 (+ 278us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.020936 (+ 176us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.021338 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9665,"thread_start_us":9474,"threads_started":1}
I20260805 23:01:04.029831 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.993664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53802 (local address 127.22.45.125:44967)
0805 23:01:03.993902 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:03.993909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.010607 (+ 16698us) server_negotiation.cc:407] Connection header received
0805 23:01:04.010804 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.010809 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.010882 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.011085 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.012701 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.013821 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.016019 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.016720 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.016865 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.020021 (+ 3156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.020027 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.020031 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.020064 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.025703 (+ 5639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.026710 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.026716 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.026720 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.027047 (+ 327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.027530 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.027535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.027538 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.028122 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.028263 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.028835 (+ 572us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.029112 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260805 23:01:04.031306 32068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:03.994216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.0.0.1:53802)
0805 23:01:04.010463 (+ 16247us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.010486 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.010661 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.011328 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.011333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.012137 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.012529 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.012543 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.014040 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.014046 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.015587 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.015601 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.017154 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.017161 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.017491 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.018636 (+ 1145us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.018661 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.019814 (+ 1153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.025897 (+ 6083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.025902 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.025907 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.026553 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.027222 (+ 669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.027227 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.027230 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.027414 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.028342 (+ 928us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.028347 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.028520 (+ 173us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.030414 (+ 1894us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.030776 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16066,"thread_start_us":15799,"threads_started":1}
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970861, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.126@KRBTEST.COM for oryx/127.22.45.125@KRBTEST.COM
I20260805 23:01:04.055946 32075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.030951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.0.0.1:53814)
0805 23:01:04.035738 (+ 4787us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.035802 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.036152 (+ 350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.036790 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.036800 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.037920 (+ 1120us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.038318 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.038336 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.039933 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.039941 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.041664 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.041701 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.043006 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.043015 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.043283 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.044228 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.044257 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.047532 (+ 3275us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.052165 (+ 4633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.052190 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.052199 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.052794 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.053299 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.053305 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.053310 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.053558 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.054706 (+ 1148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.054715 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.054909 (+ 194us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.055202 (+ 293us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.055587 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4379,"thread_start_us":4211,"threads_started":1}
I20260805 23:01:04.056001 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.031316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53814 (local address 127.22.45.125:44967)
0805 23:01:04.033518 (+ 2202us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.033524 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.035939 (+ 2415us) server_negotiation.cc:407] Connection header received
0805 23:01:04.036454 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.036459 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.036569 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.036685 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.038599 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.039693 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.041934 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.042705 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.042879 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.047813 (+ 4934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.047819 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.047822 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.047864 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.051922 (+ 4058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.052955 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.052961 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.052966 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.053160 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.054005 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.054010 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.054014 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.054458 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.054638 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.055329 (+ 691us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.055607 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2057}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.124.keytab.
Entry for principal oryx/127.22.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.124.keytab.
I20260805 23:01:04.058597 31303 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.45.125:44967: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "990bc9188b314b7094f785f00dfb708f"
member_type: NON_VOTER
last_known_addr {
host: "127.22.45.125"
port: 44967
}
attrs {
promote: true
}
}
dest_uuid: "c3ec687b45824a42bf59b08238d53e0b"
cas_config_opid_index: -1
I20260805 23:01:04.059718 31303 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } }
I20260805 23:01:04.059990 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:32851
--webserver_interface=127.22.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.124.keytab
--principal=oryx/127.22.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:01:04.076288 32002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:04.080425 32002 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Refusing update from remote peer c3ec687b45824a42bf59b08238d53e0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260805 23:01:04.081957 32077 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:04.075292 32079 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 990bc9188b314b7094f785f00dfb708f (127.22.45.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.089582 32079 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.45.125:44967
I20260805 23:01:04.090358 32077 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.090809 32077 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:04.090811 31942 master.cc:537] Master@127.22.45.125:44967 shutting down...
I20260805 23:01:04.114616 32002 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 LEARNER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 990bc9188b314b7094f785f00dfb708f (127.22.45.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.119792 32091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.120299 32091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: LEARNER
I20260805 23:01:04.120714 32047 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ec687b45824a42bf59b08238d53e0b. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.120990 32047 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: LEARNER
I20260805 23:01:04.120779 32085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.121145 32085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: LEARNER
I20260805 23:01:04.137681 31942 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 LEARNER]: Raft consensus shutting down.
I20260805 23:01:04.138327 31942 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 LEARNER]: Raft consensus is shut down!
I20260805 23:01:04.138530 31942 tablet_replica.cc:330] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: stopping tablet replica
I20260805 23:01:04.147647 31942 master.cc:552] Master@127.22.45.125:44967 shutdown complete.
I20260805 23:01:04.147895 31942 master_runner.cc:305] Clearing existing system tablet
I20260805 23:01:04.148451 31942 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:04.148602 31942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:04.151929 31942 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260805 23:01:04.153950 32096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:04.154387 31942 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:04.154853 31942 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260805 23:01:04.155076 31942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
uuid: "990bc9188b314b7094f785f00dfb708f"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "e734875043fc86a345118d351efea1b4"
server_key_iv: "a7c5e22aafc2c7dc516bcecc15dc050f"
server_key_version: "encryptionkey@0"
I20260805 23:01:04.160210 31942 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:04.168345 31942 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 23:01:04.168743 31942 log.cc:1196] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260805 23:01:04.169445 31942 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Deleting consensus metadata
I20260805 23:01:04.169836 31942 master_runner.cc:315] Copying system tablet from 127.22.45.126:39013
I20260805 23:01:04.173099 31942 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: tablet copy: Beginning tablet copy session from remote peer at address 127.22.45.126:39013
I20260805 23:01:04.196246 32043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.174308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57906 (local address 127.22.45.126:39013)
0805 23:01:04.174515 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.174521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.179646 (+ 5125us) server_negotiation.cc:407] Connection header received
0805 23:01:04.180077 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.180085 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.180197 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.180339 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.181904 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.183138 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.185033 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.185749 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.185899 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.188518 (+ 2619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.188525 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.188530 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.188577 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.192716 (+ 4139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.193732 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.193738 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.193741 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.193944 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.194402 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.194407 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.194410 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.194818 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.195019 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.195543 (+ 524us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.195837 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:01:04.196292 32102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.174239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:57906)
0805 23:01:04.179461 (+ 5222us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.179495 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.179823 (+ 328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.180618 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.180623 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.181303 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.181651 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.181667 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.183329 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.183335 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.184835 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.184858 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.185973 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.185979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.186177 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.187005 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.187029 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.188226 (+ 1197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.192950 (+ 4724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.192957 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.192961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.193571 (+ 610us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.194079 (+ 508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.194085 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.194088 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.194277 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.194990 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.194996 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.195230 (+ 234us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.195390 (+ 160us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.195774 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5023,"thread_start_us":4859,"threads_started":1}
I20260805 23:01:04.197271 31335 tablet_copy_service.cc:140] P c3ec687b45824a42bf59b08238d53e0b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 990bc9188b314b7094f785f00dfb708f ({username='oryx', principal='oryx/127.22.45.125@KRBTEST.COM'} at 127.0.0.1:57906)
I20260805 23:01:04.197579 31335 tablet_copy_service.cc:161] P c3ec687b45824a42bf59b08238d53e0b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 990bc9188b314b7094f785f00dfb708f at {username='oryx', principal='oryx/127.22.45.125@KRBTEST.COM'} at 127.0.0.1:57906: session id = 990bc9188b314b7094f785f00dfb708f-00000000000000000000000000000000
I20260805 23:01:04.202220 31335 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 23:01:04.204972 31942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 23:01:04.212931 31942 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: tablet copy: Starting download of 0 data blocks...
I20260805 23:01:04.213374 31942 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: tablet copy: Starting download of 1 WAL segments...
I20260805 23:01:04.217689 31942 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 23:01:04.224159 31335 tablet_copy_service.cc:342] P c3ec687b45824a42bf59b08238d53e0b: Request end of tablet copy session 990bc9188b314b7094f785f00dfb708f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.45.125@KRBTEST.COM'} at 127.0.0.1:57906
I20260805 23:01:04.224550 31335 tablet_copy_service.cc:433] P c3ec687b45824a42bf59b08238d53e0b: ending tablet copy session 990bc9188b314b7094f785f00dfb708f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 990bc9188b314b7094f785f00dfb708f
I20260805 23:01:04.239899 31942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:04.242645 32104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:04.243914 32105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:04.251070 32107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:04.256531 31942 server_base.cc:1034] running on GCE node
I20260805 23:01:04.256995 31942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:04.257722 31942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:04.259091 31942 hybrid_clock.cc:648] HybridClock initialized: now 1785970864259013 us; error 42 us; skew 500 ppm
I20260805 23:01:04.259369 31942 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970864, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:04.261935 31942 init.cc:377] Logged in from keytab as oryx/127.22.45.125@KRBTEST.COM (short username oryx)
I20260805 23:01:04.268498 31942 webserver.cc:460] Webserver started at http://127.22.45.125:42029/ using document root <none> and password file <none>
I20260805 23:01:04.269372 31942 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:04.269590 31942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:04.273157 31942 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260805 23:01:04.275575 32116 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:04.276115 31942 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260805 23:01:04.276271 31942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
uuid: "990bc9188b314b7094f785f00dfb708f"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "e734875043fc86a345118d351efea1b4"
server_key_iv: "a7c5e22aafc2c7dc516bcecc15dc050f"
server_key_version: "encryptionkey@0"
I20260805 23:01:04.276490 31942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:04.310405 31942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:04.316334 31942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:04.369697 31942 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.125:44967
I20260805 23:01:04.369747 32184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.125:44967 every 8 connection(s)
I20260805 23:01:04.371088 31942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
I20260805 23:01:04.375877 31931 heartbeater.cc:503] Master 127.22.45.126:39013 was elected leader, sending a full tablet report...
I20260805 23:01:04.381321 32186 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:01:04.386188 32186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Bootstrap starting.
I20260805 23:01:04.404978 32186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:01:04.405735 32186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: Bootstrap complete.
I20260805 23:01:04.407207 32186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } }
I20260805 23:01:04.407625 32186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 990bc9188b314b7094f785f00dfb708f, State: Initialized, Role: LEARNER
I20260805 23:01:04.407969 32186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } }
I20260805 23:01:04.408989 32191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.409451 32191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: LEARNER
I20260805 23:01:04.409479 32186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:04.420943 32205 catalog_manager.cc:1259] Loaded cluster ID: 7f0887d5ddcd4014a6505c81e0925320
I20260805 23:01:04.421087 32205 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: loading cluster ID for follower catalog manager: success
I20260805 23:01:04.425534 32205 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: acquiring CA information for follower catalog manager: success
I20260805 23:01:04.428954 32205 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260805 23:01:04.547395 32080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:04.547744 32080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:04.547940 32080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:04.556030 32080 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:04.556201 32080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:04.556318 32080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:04.556398 32080 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:04.556460 32080 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:04.568187 32080 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.124.keytab
--principal=oryx/127.22.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:32851
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:04.569896 32080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:04.571473 32080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:04.590269 32214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:04.591012 32213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:04.591504 32216 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:04.591732 32080 server_base.cc:1034] running on GCE node
I20260805 23:01:04.591967 32077 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.592310 32077 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:04.593310 32080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:04.602144 32080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:04.605762 32080 hybrid_clock.cc:648] HybridClock initialized: now 1785970864605587 us; error 153 us; skew 500 ppm
I20260805 23:01:04.606626 32080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970864, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:04.611239 32080 init.cc:377] Logged in from keytab as oryx/127.22.45.124@KRBTEST.COM (short username oryx)
I20260805 23:01:04.613369 32220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.592775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.0.0.1:34226)
0805 23:01:04.604179 (+ 11404us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.604199 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.604381 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.604890 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.604898 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.604941 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:04.605203 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.605217 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.607363 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.607370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.609811 (+ 2441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.609841 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.612297 (+ 2456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.612306 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.612540 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.612642 (+ 102us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.612769 (+ 127us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.612953 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11276,"thread_start_us":11072,"threads_started":1}
I20260805 23:01:04.613425 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.592888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34226 (local address 127.22.45.125:44967)
0805 23:01:04.603621 (+ 10733us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.603630 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.604319 (+ 689us) server_negotiation.cc:407] Connection header received
0805 23:01:04.604531 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.604536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.604635 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.604773 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:04.605410 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.607094 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.610197 (+ 3103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.611991 (+ 1794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.612208 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.612600 (+ 392us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.612813 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.612979 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10554,"thread_start_us":10342,"threads_started":1}
I20260805 23:01:04.615051 32191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ec687b45824a42bf59b08238d53e0b. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.615383 32191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: LEARNER
I20260805 23:01:04.616285 32218 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: attempting to promote NON_VOTER 990bc9188b314b7094f785f00dfb708f to VOTER
I20260805 23:01:04.617446 32218 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } }
I20260805 23:01:04.619976 32153 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 LEARNER]: Refusing update from remote peer c3ec687b45824a42bf59b08238d53e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260805 23:01:04.620779 32219 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260805 23:01:04.625447 32218 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 990bc9188b314b7094f785f00dfb708f (127.22.45.125) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } }
I20260805 23:01:04.626322 32153 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, 990bc9188b314b7094f785f00dfb708f (127.22.45.125) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } }
I20260805 23:01:04.630792 32077 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } }
I20260805 23:01:04.631165 32077 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:04.631379 32077 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } }
I20260805 23:01:04.631325 32191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } }
I20260805 23:01:04.631575 32077 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:04.631587 32191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:01:04.637354 32080 webserver.cc:460] Webserver started at http://127.22.45.124:43995/ using document root <none> and password file <none>
I20260805 23:01:04.638202 32080 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:04.638363 32080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:04.638720 32080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:04.642217 32080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/instance:
uuid: "75b857da4ff940f49befbfeab8e7a904"
format_stamp: "Formatted at 2026-08-05 23:01:04 on dist-test-slave-1vmg"
server_key: "545e28e4efe9f1da731766a070f57622"
server_key_iv: "6760596467a2304655b0a81e0a5d0c23"
server_key_version: "encryptionkey@0"
I20260805 23:01:04.643153 32080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal/instance:
uuid: "75b857da4ff940f49befbfeab8e7a904"
format_stamp: "Formatted at 2026-08-05 23:01:04 on dist-test-slave-1vmg"
server_key: "545e28e4efe9f1da731766a070f57622"
server_key_iv: "6760596467a2304655b0a81e0a5d0c23"
server_key_version: "encryptionkey@0"
I20260805 23:01:04.649997 32080 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 23:01:04.654706 32232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:04.656400 32080 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:01:04.656615 32080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
uuid: "75b857da4ff940f49befbfeab8e7a904"
format_stamp: "Formatted at 2026-08-05 23:01:04 on dist-test-slave-1vmg"
server_key: "545e28e4efe9f1da731766a070f57622"
server_key_iv: "6760596467a2304655b0a81e0a5d0c23"
server_key_version: "encryptionkey@0"
I20260805 23:01:04.656837 32080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:04.674567 32080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:04.679867 32080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:04.680169 32080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:04.710022 32080 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.124:32851
I20260805 23:01:04.710041 32304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.124:32851 every 8 connection(s)
I20260805 23:01:04.711812 32080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
I20260805 23:01:04.716696 32305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:04.721897 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 32080
I20260805 23:01:04.724932 32305 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970864, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.124@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.124@KRBTEST.COM
I20260805 23:01:04.762753 32313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.730332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51946 (local address 127.22.45.126:39013)
0805 23:01:04.740795 (+ 10463us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.740802 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.742148 (+ 1346us) server_negotiation.cc:407] Connection header received
0805 23:01:04.743578 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.743583 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.743670 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.743788 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.745900 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.746968 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.749453 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.750334 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.750477 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.754431 (+ 3954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.754437 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.754440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.754477 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.758245 (+ 3768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.759410 (+ 1165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.759417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.759421 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.759609 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.760179 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.760185 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.760189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.760600 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.760760 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.761894 (+ 1134us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.762172 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10293,"thread_start_us":10114,"threads_started":1}
I20260805 23:01:04.764514 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.724816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59086 (local address 127.22.45.124:32851)
0805 23:01:04.740831 (+ 16015us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.740856 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.740937 (+ 81us) server_negotiation.cc:407] Connection header received
0805 23:01:04.743198 (+ 2261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.743239 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.743608 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.743840 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.746043 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.748293 (+ 2250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.749994 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.750832 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.750987 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.756751 (+ 5764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.756765 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.756785 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.756825 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.760718 (+ 3893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.761617 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.761624 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.761626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.761781 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.762337 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.762342 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.762346 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.762809 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.763285 (+ 476us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.763663 (+ 378us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.763931 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":15223,"thread_start_us":14921,"threads_started":1}
I20260805 23:01:04.764951 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.729425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:51946)
0805 23:01:04.741525 (+ 12100us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.741600 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.743199 (+ 1599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.743895 (+ 696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.743903 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.744952 (+ 1049us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.745628 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.745662 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.747130 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.747136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.749268 (+ 2132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.749285 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.750623 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.750632 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.750888 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.751770 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.751805 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.754222 (+ 2417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.758400 (+ 4178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.758415 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.758432 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.759265 (+ 833us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.759745 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.759751 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.759755 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.760033 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.760752 (+ 719us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.760762 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.761372 (+ 610us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.761765 (+ 393us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.762399 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11772,"mutex_wait_us":138,"thread_start_us":11567,"threads_started":1}
I20260805 23:01:04.766655 32305 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970864, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.124@KRBTEST.COM for oryx/127.22.45.125@KRBTEST.COM
I20260805 23:01:04.784575 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.767791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34230 (local address 127.22.45.125:44967)
0805 23:01:04.768548 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.768555 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.768577 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:01:04.768644 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.768649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.768746 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.768856 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.769876 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.771176 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.772568 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.773262 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.773412 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.776765 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.776773 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.776778 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.776827 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.780997 (+ 4170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.782157 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.782163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.782168 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.782451 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.782992 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.782998 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.783002 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.783425 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.783560 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.784088 (+ 528us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.784319 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576}
I20260805 23:01:04.784757 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.767642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.0.0.1:34230)
0805 23:01:04.767888 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.767906 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.768000 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.768886 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.768890 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.769466 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.769717 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.769729 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.771329 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.771334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.772394 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.772415 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.773442 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.773447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.773624 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.774247 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.774266 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.776503 (+ 2237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.781204 (+ 4701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.781212 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.781216 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.781957 (+ 741us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.782621 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.782627 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.782631 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.782842 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.783558 (+ 716us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.783563 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.783799 (+ 236us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.783975 (+ 176us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.784371 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 23:01:04.785912 32305 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970864, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.124@KRBTEST.COM for oryx/127.22.45.124@KRBTEST.COM
I20260805 23:01:04.802341 32312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.786702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.0.0.1:59090)
0805 23:01:04.786906 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.786955 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.787083 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.787401 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.787406 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.787944 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.788157 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.788170 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.789369 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.789375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.790785 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.790806 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.791773 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.791780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.791998 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.792799 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.792827 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.795911 (+ 3084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.799270 (+ 3359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.799277 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.799282 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.799855 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.800379 (+ 524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.800384 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.800388 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.800605 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.801296 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.801301 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.801439 (+ 138us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.801579 (+ 140us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.801880 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260805 23:01:04.802367 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.787013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59090 (local address 127.22.45.124:32851)
0805 23:01:04.787159 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.787164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.787179 (+ 15us) server_negotiation.cc:407] Connection header received
0805 23:01:04.787221 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.787225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.787280 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.787356 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.788327 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.789219 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.791028 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.791587 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.791715 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.796187 (+ 4472us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.796192 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.796195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.796229 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.799101 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.800035 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.800039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.800041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.800257 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.800733 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.800737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.800739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.801154 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.801307 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.801708 (+ 401us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.802055 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":111,"server-negotiator.queue_time_us":46}
I20260805 23:01:04.810142 32305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Bootstrap starting.
I20260805 23:01:04.815362 32305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:04.817417 32305 log.cc:824] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:04.822254 32305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: No bootstrap required, opened a new log
I20260805 23:01:04.835284 32305 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } }
I20260805 23:01:04.835880 32305 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:04.836022 32305 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75b857da4ff940f49befbfeab8e7a904, State: Initialized, Role: FOLLOWER
I20260805 23:01:04.836862 32305 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } }
I20260805 23:01:04.838181 32316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } } }
I20260805 23:01:04.838662 32316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:01:04.840167 32305 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: configured and running, proceeding with master startup.
W20260805 23:01:04.854633 32330 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:01:04.854828 32330 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 23:01:04.856657 32080 master_runner.cc:428] Detected that this master 75b857da4ff940f49befbfeab8e7a904 is joining an existing cluster
I20260805 23:01:04.856817 32080 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.45.124:32851
I20260805 23:01:04.872380 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 31391
I20260805 23:01:04.881764 32313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.862352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.22.45.126:39013)
0805 23:01:04.862571 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.862578 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.863717 (+ 1139us) server_negotiation.cc:407] Connection header received
0805 23:01:04.863966 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.863973 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.864105 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.864227 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.866146 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.867289 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.869509 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.870134 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.870235 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.873252 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.873260 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.873264 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.873309 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.877055 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.878433 (+ 1378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.878440 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.878443 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.878649 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.879292 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.879298 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.879301 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.880125 (+ 824us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.880277 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.881077 (+ 800us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.881374 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 23:01:04.883466 32337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.862581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:51962)
0805 23:01:04.863571 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.863592 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.863816 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.864438 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.864444 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.865361 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.865911 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.865926 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.867504 (+ 1578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.867509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.869327 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.869342 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.870534 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.870541 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.870737 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.871545 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.871568 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.873020 (+ 1452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.877509 (+ 4489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.877514 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.877518 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.878272 (+ 754us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.878883 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.878888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.878892 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.879101 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.880448 (+ 1347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.880453 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.880731 (+ 278us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.882076 (+ 1345us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.882957 (+ 881us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":830,"mutex_wait_us":25,"thread_start_us":647,"threads_started":1}
I20260805 23:01:04.886636 32223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.862576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34236 (local address 127.22.45.125:44967)
0805 23:01:04.862756 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.862761 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.864750 (+ 1989us) server_negotiation.cc:407] Connection header received
0805 23:01:04.865066 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.865072 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.865155 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.865226 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.868646 (+ 3420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.869715 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.871807 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.872440 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.872565 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.876962 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.876969 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.876973 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.877029 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.882435 (+ 5406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.883524 (+ 1089us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.883530 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.883940 (+ 410us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.884154 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.884681 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.884686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.884689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.885098 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.885245 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.885963 (+ 718us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.886272 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 23:01:04.888238 32338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.863148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.0.0.1:34236)
0805 23:01:04.864633 (+ 1485us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.864653 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.864888 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.865471 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.865475 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.866740 (+ 1265us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.868443 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.868457 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.869918 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.869923 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.871624 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.871638 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.872988 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.872994 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.873209 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.873960 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.873988 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.876665 (+ 2677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.882615 (+ 5950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.882620 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.882624 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.883328 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.884328 (+ 1000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.884332 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.884335 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.884526 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.885328 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.885334 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.885637 (+ 303us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.887246 (+ 1609us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.887648 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1301,"mutex_wait_us":57,"thread_start_us":1067,"threads_started":1}
I20260805 23:01:04.888500 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.865234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59092 (local address 127.22.45.124:32851)
0805 23:01:04.865396 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.865413 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.867328 (+ 1915us) server_negotiation.cc:407] Connection header received
0805 23:01:04.867481 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.867487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.867575 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.867684 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.869249 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.870400 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.872241 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.873051 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.873166 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.876382 (+ 3216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.876389 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.876397 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.876432 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.884868 (+ 8436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.885935 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.885942 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.885946 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.886167 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.886563 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.886567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.886571 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.887056 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.887212 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.887782 (+ 570us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.888061 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":68}
I20260805 23:01:04.889390 32339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.864703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.0.0.1:59092)
0805 23:01:04.867213 (+ 2510us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.867232 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.867363 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.867736 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.867741 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.868544 (+ 803us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.869080 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.869095 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.870639 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.870646 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.872090 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.872104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.873839 (+ 1735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.873846 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.874045 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.874645 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.874680 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.876164 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.885060 (+ 8896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.885065 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.885070 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.885786 (+ 716us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.886307 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.886312 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.886315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.886455 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.887278 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.887283 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.887461 (+ 178us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.888282 (+ 821us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.888877 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2383,"mutex_wait_us":1,"thread_start_us":2209,"threads_started":1}
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970861, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.126@KRBTEST.COM for oryx/127.22.45.124@KRBTEST.COM
Aug 05 23:01:04 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.65@KRBTEST.COM
I20260805 23:01:04.909215 32311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.891327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59098 (local address 127.22.45.124:32851)
0805 23:01:04.891481 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.891487 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.891508 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:01:04.891673 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.891678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.891788 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.891893 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.893032 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.893728 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.895620 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.896237 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.897021 (+ 784us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.900694 (+ 3673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.900702 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.900707 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.900758 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.905716 (+ 4958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.906885 (+ 1169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.906892 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.906895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.907138 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.907603 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.907608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.907611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.907963 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.908123 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.908588 (+ 465us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.908845 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 23:01:04.909873 32220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.891177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.0.0.1:59098)
0805 23:01:04.891384 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:04.891406 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:04.891530 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:04.891965 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:04.891971 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:04.892603 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:04.892845 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.892859 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.893914 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.893920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.895406 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:04.895429 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.896463 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.896470 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:04.896648 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.897366 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:04.897386 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:04.900415 (+ 3029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:04.905970 (+ 5555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.905978 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.905983 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.906684 (+ 701us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.907300 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:04.907304 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:04.907307 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:04.907472 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:04.908109 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:04.908114 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:04.908307 (+ 193us) client_negotiation.cc:769] Sending connection context
0805 23:01:04.908443 (+ 136us) client_negotiation.cc:240] Negotiation successful
0805 23:01:04.908794 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260805 23:01:04.911839 31303 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.45.124:32851: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "75b857da4ff940f49befbfeab8e7a904"
member_type: NON_VOTER
last_known_addr {
host: "127.22.45.124"
port: 32851
}
attrs {
promote: true
}
}
dest_uuid: "c3ec687b45824a42bf59b08238d53e0b"
cas_config_opid_index: 6
I20260805 23:01:04.912652 31303 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } }
I20260805 23:01:04.915479 32153 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Refusing update from remote peer c3ec687b45824a42bf59b08238d53e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260805 23:01:04.915719 32269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:04.916363 32218 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260805 23:01:04.919237 32340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:04.873803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53418 (local address 127.22.45.65:33525)
0805 23:01:04.894773 (+ 20970us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:04.894783 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:04.894819 (+ 36us) server_negotiation.cc:407] Connection header received
0805 23:01:04.894900 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:04.894938 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:04.895282 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:04.895491 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:04.897793 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.899468 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.901132 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:04.902167 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:04.902340 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:04.909369 (+ 7029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:04.909396 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:04.909419 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:04.909471 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:04.914088 (+ 4617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.915325 (+ 1237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.915336 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.915340 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.915537 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:04.916119 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:04.916124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:04.916128 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:04.916671 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:04.918177 (+ 1506us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:04.918403 (+ 226us) server_negotiation.cc:299] Negotiation successful
0805 23:01:04.918754 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20753,"thread_start_us":21212,"threads_started":1}
I20260805 23:01:04.920619 32269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 FOLLOWER]: Refusing update from remote peer c3ec687b45824a42bf59b08238d53e0b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260805 23:01:04.920393 32218 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 75b857da4ff940f49befbfeab8e7a904 (127.22.45.124) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:04.920922 31559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:04.923679 32229 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:04.926158 32153 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 75b857da4ff940f49befbfeab8e7a904 (127.22.45.124) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:04.932317 32218 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.45.124:32851
W20260805 23:01:04.932827 32245 tablet.cc:2369] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:04.933179 32080 master.cc:537] Master@127.22.45.124:32851 shutting down...
I20260805 23:01:04.940156 32229 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:04.940619 32229 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:04.941037 32218 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:04.941380 32218 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:04.942046 32191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:04.942590 32191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:01:04.951507 32269 raft_consensus.cc:858] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } }
W20260805 23:01:04.951737 32269 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } }
I20260805 23:01:04.966496 32269 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 990bc9188b314b7094f785f00dfb708f (127.22.45.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.979592 32352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.980173 32352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260805 23:01:04.980676 32316 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ec687b45824a42bf59b08238d53e0b. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.980934 32316 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260805 23:01:04.980659 32347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: NON_VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: true } } }
I20260805 23:01:04.981209 32347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260805 23:01:04.982600 32229 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:04.982899 32229 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
W20260805 23:01:04.984699 31283 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260805 23:01:04.985261 32080 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260805 23:01:04.985860 32080 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260805 23:01:04.986066 32080 tablet_replica.cc:330] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: stopping tablet replica
W20260805 23:01:04.992125 32243 connection.cc:441] server connection from 127.0.0.1:59098 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59098 (request call id 4) could send its response
W20260805 23:01:04.992684 31283 consensus_peers.cc:487] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b -> Peer 75b857da4ff940f49befbfeab8e7a904 (127.22.45.124:32851): Couldn't send request to peer 75b857da4ff940f49befbfeab8e7a904. Status: Network error: recv got EOF from 127.22.45.124:32851 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260805 23:01:04.995448 32080 master.cc:552] Master@127.22.45.124:32851 shutdown complete.
I20260805 23:01:04.995543 32080 master_runner.cc:305] Clearing existing system tablet
I20260805 23:01:04.995890 32080 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:04.996002 32080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:04.998345 32080 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260805 23:01:04.999996 32356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:05.000440 32080 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:05.000736 32080 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260805 23:01:05.000874 32080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
uuid: "75b857da4ff940f49befbfeab8e7a904"
format_stamp: "Formatted at 2026-08-05 23:01:04 on dist-test-slave-1vmg"
server_key: "545e28e4efe9f1da731766a070f57622"
server_key_iv: "6760596467a2304655b0a81e0a5d0c23"
server_key_version: "encryptionkey@0"
I20260805 23:01:05.004532 32080 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:05.010260 32080 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260805 23:01:05.010576 32080 log.cc:1196] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260805 23:01:05.011201 32080 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Deleting consensus metadata
I20260805 23:01:05.011462 32080 master_runner.cc:315] Copying system tablet from 127.22.45.126:39013
I20260805 23:01:05.016280 32080 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: tablet copy: Beginning tablet copy session from remote peer at address 127.22.45.126:39013
I20260805 23:01:05.032133 32363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.017228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:51972)
0805 23:01:05.017947 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:05.017967 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:05.018139 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:05.018532 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:05.018538 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:05.019155 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:05.019494 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.019508 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.020903 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.020908 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.022083 (+ 1175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.022100 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.023080 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.023087 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.023272 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.023968 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:05.023989 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:05.025045 (+ 1056us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:05.029255 (+ 4210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.029262 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.029267 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.029736 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.030192 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.030199 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.030203 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.030387 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.031025 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:05.031031 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:05.031223 (+ 192us) client_negotiation.cc:769] Sending connection context
0805 23:01:05.031368 (+ 145us) client_negotiation.cc:240] Negotiation successful
0805 23:01:05.031716 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":434,"threads_started":1}
I20260805 23:01:05.033247 32313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.017230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51972 (local address 127.22.45.126:39013)
0805 23:01:05.017506 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:05.017514 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:05.018073 (+ 559us) server_negotiation.cc:407] Connection header received
0805 23:01:05.018295 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:05.018301 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:05.018376 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:05.018469 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:05.019675 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.020712 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.022261 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.022878 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.023060 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.025376 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:05.025383 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:05.025386 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:05.025426 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:05.029063 (+ 3637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.029878 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.029885 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.029890 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.030057 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.030504 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.030511 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.030514 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.030835 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:05.031018 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:05.032615 (+ 1597us) server_negotiation.cc:299] Negotiation successful
0805 23:01:05.032880 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260805 23:01:05.033818 31335 tablet_copy_service.cc:140] P c3ec687b45824a42bf59b08238d53e0b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 75b857da4ff940f49befbfeab8e7a904 ({username='oryx', principal='oryx/127.22.45.124@KRBTEST.COM'} at 127.0.0.1:51972)
I20260805 23:01:05.034015 31335 tablet_copy_service.cc:161] P c3ec687b45824a42bf59b08238d53e0b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 75b857da4ff940f49befbfeab8e7a904 at {username='oryx', principal='oryx/127.22.45.124@KRBTEST.COM'} at 127.0.0.1:51972: session id = 75b857da4ff940f49befbfeab8e7a904-00000000000000000000000000000000
I20260805 23:01:05.036778 31335 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: Tablet Copy: opened 0 blocks and 1 log segments
I20260805 23:01:05.038679 32080 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260805 23:01:05.044430 32080 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: tablet copy: Starting download of 0 data blocks...
I20260805 23:01:05.044812 32080 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: tablet copy: Starting download of 1 WAL segments...
I20260805 23:01:05.047439 32080 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260805 23:01:05.051278 31335 tablet_copy_service.cc:342] P c3ec687b45824a42bf59b08238d53e0b: Request end of tablet copy session 75b857da4ff940f49befbfeab8e7a904-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.45.124@KRBTEST.COM'} at 127.0.0.1:51972
I20260805 23:01:05.051450 31335 tablet_copy_service.cc:433] P c3ec687b45824a42bf59b08238d53e0b: ending tablet copy session 75b857da4ff940f49befbfeab8e7a904-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 75b857da4ff940f49befbfeab8e7a904
I20260805 23:01:05.064791 32080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:05.068008 32364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:05.069048 32366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:05.077028 32080 server_base.cc:1034] running on GCE node
W20260805 23:01:05.077488 32368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:05.078048 32080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:05.078768 32080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:05.080091 32080 hybrid_clock.cc:648] HybridClock initialized: now 1785970865079988 us; error 58 us; skew 500 ppm
I20260805 23:01:05.080607 32080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:05 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970865, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:05.083118 32080 init.cc:377] Logged in from keytab as oryx/127.22.45.124@KRBTEST.COM (short username oryx)
I20260805 23:01:05.090679 32080 webserver.cc:460] Webserver started at http://127.22.45.124:42285/ using document root <none> and password file <none>
I20260805 23:01:05.091070 32080 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:05.091198 32080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:05.094576 32080 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260805 23:01:05.097071 32375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:05.097544 32080 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260805 23:01:05.097685 32080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
uuid: "75b857da4ff940f49befbfeab8e7a904"
format_stamp: "Formatted at 2026-08-05 23:01:04 on dist-test-slave-1vmg"
server_key: "545e28e4efe9f1da731766a070f57622"
server_key_iv: "6760596467a2304655b0a81e0a5d0c23"
server_key_version: "encryptionkey@0"
I20260805 23:01:05.097879 32080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:05.102560 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 31391
I20260805 23:01:05.138293 32080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:05.140372 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:33525
--local_ip_for_outbound_sockets=127.22.45.65
--tserver_master_addrs=127.22.45.126:39013
--webserver_port=39047
--webserver_interface=127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab
--principal=oryx/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:01:05.142413 32080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:05.363279 32445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.124:32851 every 8 connection(s)
I20260805 23:01:05.363561 32080 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.124:32851
I20260805 23:01:05.364693 32080 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
I20260805 23:01:05.376304 32446 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:01:05.384150 32446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Bootstrap starting.
I20260805 23:01:05.408486 32446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:01:05.409175 32446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Bootstrap complete.
I20260805 23:01:05.410473 32446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } }
I20260805 23:01:05.410820 32446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 75b857da4ff940f49befbfeab8e7a904, State: Initialized, Role: LEARNER
I20260805 23:01:05.411216 32446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } }
I20260805 23:01:05.419237 32446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:05.420596 32451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:05.421028 32451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: LEARNER
I20260805 23:01:05.495601 32465 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 23:01:05.578024 32466 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:05.578375 32466 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:05.597195 32469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.578282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.0.0.1:59102)
0805 23:01:05.582017 (+ 3735us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:05.582053 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:05.582263 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:05.583147 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:05.583151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:05.583617 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:05.583802 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.583812 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.585716 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.585721 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.586631 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.586646 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.587742 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.587749 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.587911 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.588663 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:05.588682 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:05.589510 (+ 828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:05.594368 (+ 4858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.594373 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.594377 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.594852 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.595371 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.595376 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.595378 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.595542 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.596249 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:05.596254 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:05.596416 (+ 162us) client_negotiation.cc:769] Sending connection context
0805 23:01:05.596583 (+ 167us) client_negotiation.cc:240] Negotiation successful
0805 23:01:05.596896 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3539,"thread_start_us":3391,"threads_started":1}
I20260805 23:01:05.597430 32472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.578399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59102 (local address 127.22.45.124:32851)
0805 23:01:05.582689 (+ 4290us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:05.582696 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:05.582726 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:01:05.582811 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:05.582818 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:05.582965 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:05.583106 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:05.583998 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.585524 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.586814 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.587519 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.587686 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.589814 (+ 2128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:05.589822 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:05.589827 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:05.589873 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:05.594144 (+ 4271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.595059 (+ 915us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.595064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.595066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.595229 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.595666 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.595670 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.595673 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.596104 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:05.596249 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:05.596751 (+ 502us) server_negotiation.cc:299] Negotiation successful
0805 23:01:05.597010 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4136,"thread_start_us":4013,"threads_started":1}
I20260805 23:01:05.598263 32413 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.5->[1.6-1.7] Dedup: 1.7->[]
I20260805 23:01:05.598698 32451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3ec687b45824a42bf59b08238d53e0b. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: NON_VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: true } } }
I20260805 23:01:05.599031 32451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: LEARNER
I20260805 23:01:05.599459 32467 raft_consensus.cc:1050] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: attempting to promote NON_VOTER 75b857da4ff940f49befbfeab8e7a904 to VOTER
I20260805 23:01:05.600344 32467 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } }
I20260805 23:01:05.602717 32413 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 LEARNER]: Refusing update from remote peer c3ec687b45824a42bf59b08238d53e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260805 23:01:05.602855 32153 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Refusing update from remote peer c3ec687b45824a42bf59b08238d53e0b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260805 23:01:05.603709 32468 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260805 23:01:05.604269 32466 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [LEADER]: Connected to new peer: Peer: permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260805 23:01:05.607218 32466 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 75b857da4ff940f49befbfeab8e7a904 (127.22.45.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.608065 32153 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 75b857da4ff940f49befbfeab8e7a904 (127.22.45.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.611778 32466 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.612079 32466 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:05.610353 32413 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 75b857da4ff940f49befbfeab8e7a904 (127.22.45.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.612365 32468 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.612630 32468 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:05.612962 32468 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.613256 32468 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:05.616724 32451 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.617110 32451 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:01:05.619851 32474 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c3ec687b45824a42bf59b08238d53e0b" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:05.620191 32474 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: FOLLOWER
W20260805 23:01:05.672168 32400 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:05.672629 32400 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:05.672824 32400 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:05.681285 32400 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:05.681458 32400 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:05.681622 32400 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:05.692610 32400 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab
--principal=oryx/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:33525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=39047
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:05.694242 32400 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:05.695854 32400 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:05.712072 32484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:05.712127 32486 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:05.712150 32488 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:05.713064 32400 server_base.cc:1034] running on GCE node
I20260805 23:01:05.714051 32400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:05.715286 32400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:05.716527 32400 hybrid_clock.cc:648] HybridClock initialized: now 1785970865716441 us; error 81 us; skew 500 ppm
I20260805 23:01:05.716897 32400 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:05 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970865, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:05.720945 32400 init.cc:377] Logged in from keytab as oryx/127.22.45.65@KRBTEST.COM (short username oryx)
I20260805 23:01:05.722720 32400 webserver.cc:460] Webserver started at http://127.22.45.65:39047/ using document root <none> and password file <none>
I20260805 23:01:05.723557 32400 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:05.723726 32400 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:05.730387 32400 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260805 23:01:05.733316 32497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:05.734872 32400 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260805 23:01:05.735072 32400 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "1fc6712346d34d52ac512258e82813d0"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "2718e9f11045b861ef5cc2315c1a1dfd"
server_key_iv: "10d3a57306644242063844edd80b431d"
server_key_version: "encryptionkey@0"
I20260805 23:01:05.736085 32400 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:05.757227 32400 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:05.762120 32400 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:05.762403 32400 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:05.763581 32400 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:05.765113 32400 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:05.765215 32400 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:05.765313 32400 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:05.765370 32400 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:05.808068 32400 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:33525
I20260805 23:01:05.808221 32648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:33525 every 8 connection(s)
I20260805 23:01:05.809930 32400 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:05.816481 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 32400
I20260805 23:01:05.816860 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 31572
Aug 05 23:01:05 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970865, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.124@KRBTEST.COM
Aug 05 23:01:05 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970865, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
Aug 05 23:01:05 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970865, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.125@KRBTEST.COM
Aug 05 23:01:05 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.66@KRBTEST.COM
I20260805 23:01:05.848975 32657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.813675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:33981 (local address 127.22.45.126:39013)
0805 23:01:05.824708 (+ 11033us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:05.824716 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:05.824756 (+ 40us) server_negotiation.cc:407] Connection header received
0805 23:01:05.824842 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:05.824849 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:05.824945 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:05.825133 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:05.827741 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.829281 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.832901 (+ 3620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.833661 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.833934 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.840046 (+ 6112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:05.840055 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:05.840060 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:05.840116 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:05.844345 (+ 4229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.846632 (+ 2287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.846637 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.846639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.846792 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.847285 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.847289 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.847291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.847597 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:05.847741 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:05.848265 (+ 524us) server_negotiation.cc:299] Negotiation successful
0805 23:01:05.848556 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10854,"thread_start_us":11667,"threads_started":1}
I20260805 23:01:05.849351 32472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.822876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:52657 (local address 127.22.45.124:32851)
0805 23:01:05.823126 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:05.823132 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:05.823744 (+ 612us) server_negotiation.cc:407] Connection header received
0805 23:01:05.824037 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:05.824044 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:05.824168 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:05.824250 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:05.828574 (+ 4324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.829590 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.832942 (+ 3352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.833427 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.833633 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.839998 (+ 6365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:05.840005 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:05.840009 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:05.840052 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:05.843779 (+ 3727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.845247 (+ 1468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.845257 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.845260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.845450 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.846234 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.846240 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.846244 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.846861 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:05.847075 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:05.848623 (+ 1548us) server_negotiation.cc:299] Negotiation successful
0805 23:01:05.848917 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260805 23:01:05.851671 32658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.814283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.65:33981)
0805 23:01:05.815249 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:05.815301 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:05.818067 (+ 2766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:05.825132 (+ 7065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:05.825137 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:05.826196 (+ 1059us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:05.827431 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.827501 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.829750 (+ 2249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.829756 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.832707 (+ 2951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.832730 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.834102 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.834108 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.834274 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.835305 (+ 1031us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:05.835354 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:05.839465 (+ 4111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:05.845788 (+ 6323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.845793 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.845797 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.846466 (+ 669us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.846953 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.846959 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.846962 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.847164 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.847724 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:05.847728 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:05.847940 (+ 212us) client_negotiation.cc:769] Sending connection context
0805 23:01:05.848138 (+ 198us) client_negotiation.cc:240] Negotiation successful
0805 23:01:05.848918 (+ 780us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"mutex_wait_us":303,"spinlock_wait_cycles":16128,"thread_start_us":489,"threads_started":1}
I20260805 23:01:05.851709 32659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.814283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.22.45.65:56907)
0805 23:01:05.821046 (+ 6763us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:05.821073 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:05.821229 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:05.826467 (+ 5238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:05.826483 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:05.827307 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:05.827815 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.827833 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.829663 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.829668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.832726 (+ 3058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.832746 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.834014 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.834021 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.834204 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.835499 (+ 1295us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:05.835524 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:05.841473 (+ 5949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:05.845783 (+ 4310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.845789 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.845793 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.846451 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.847854 (+ 1403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.847859 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.847862 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.848031 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.849962 (+ 1931us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:05.849967 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:05.850196 (+ 229us) client_negotiation.cc:769] Sending connection context
0805 23:01:05.850367 (+ 171us) client_negotiation.cc:240] Negotiation successful
0805 23:01:05.850673 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6568,"mutex_wait_us":630,"spinlock_wait_cycles":673408,"thread_start_us":7459,"threads_started":1}
I20260805 23:01:05.852345 32656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.813685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:56907 (local address 127.22.45.125:44967)
0805 23:01:05.826083 (+ 12398us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:05.826088 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:05.826113 (+ 25us) server_negotiation.cc:407] Connection header received
0805 23:01:05.826174 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:05.826178 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:05.826248 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:05.826385 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:05.828068 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.829404 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.832945 (+ 3541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.833768 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.834452 (+ 684us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.841839 (+ 7387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:05.841848 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:05.841853 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:05.841910 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:05.845636 (+ 3726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.846984 (+ 1348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.846990 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.846993 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.847159 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.849371 (+ 2212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.849377 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.849380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.849809 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:05.851377 (+ 1568us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:05.851566 (+ 189us) server_negotiation.cc:299] Negotiation successful
0805 23:01:05.851840 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12103,"thread_start_us":11941,"threads_started":1}
I20260805 23:01:05.853157 32664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.822660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.22.45.65:52657)
0805 23:01:05.823618 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:05.823642 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:05.823878 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:05.824997 (+ 1119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:05.825015 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:05.827988 (+ 2973us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:05.828312 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.828325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.829815 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.829817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.832714 (+ 2897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:05.832730 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.833779 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.833789 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:05.834197 (+ 408us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.835306 (+ 1109us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:05.835355 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:05.839715 (+ 4360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:05.844057 (+ 4342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.844071 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.844095 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.844901 (+ 806us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.845629 (+ 728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:05.845636 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:05.845640 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:05.846017 (+ 377us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:05.847177 (+ 1160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:05.847188 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:05.847777 (+ 589us) client_negotiation.cc:769] Sending connection context
0805 23:01:05.848142 (+ 365us) client_negotiation.cc:240] Negotiation successful
0805 23:01:05.849962 (+ 1820us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":812,"mutex_wait_us":1205,"spinlock_wait_cycles":40448,"thread_start_us":638,"threads_started":1}
I20260805 23:01:05.854038 32651 heartbeater.cc:347] Connected to a master server at 127.22.45.125:44967
I20260805 23:01:05.854496 32651 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:05.854533 32649 heartbeater.cc:347] Connected to a master server at 127.22.45.124:32851
I20260805 23:01:05.854696 32649 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:05.855125 32650 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39013
I20260805 23:01:05.855244 32650 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:05.855960 32649 heartbeater.cc:511] Master 127.22.45.124:32851 requested a full tablet report, sending...
I20260805 23:01:05.856217 32651 heartbeater.cc:511] Master 127.22.45.125:44967 requested a full tablet report, sending...
I20260805 23:01:05.856223 32650 heartbeater.cc:511] Master 127.22.45.126:39013 requested a full tablet report, sending...
I20260805 23:01:05.858503 31303 ts_manager.cc:194] Re-registered known tserver with Master: 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525)
I20260805 23:01:05.859138 32139 ts_manager.cc:194] Registered new tserver with Master: 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525)
I20260805 23:01:05.859223 32662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:05.818999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56130 (local address 127.22.45.66:36051)
0805 23:01:05.822073 (+ 3074us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:05.822083 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:05.827571 (+ 5488us) server_negotiation.cc:407] Connection header received
0805 23:01:05.828924 (+ 1353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:05.828936 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:05.829287 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:05.829427 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:05.832184 (+ 2757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.836091 (+ 3907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.838045 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:05.839076 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:05.839231 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:05.847791 (+ 8560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:05.847817 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:05.847838 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:05.847888 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:05.852866 (+ 4978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.855003 (+ 2137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.855025 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.855028 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.855256 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:05.855915 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:05.855921 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:05.855924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:05.856518 (+ 594us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:05.856950 (+ 432us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:05.858333 (+ 1383us) server_negotiation.cc:299] Negotiation successful
0805 23:01:05.858659 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2866,"thread_start_us":2890,"threads_started":1}
I20260805 23:01:05.859402 32401 ts_manager.cc:194] Registered new tserver with Master: 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525)
I20260805 23:01:05.859822 31303 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:33981
I20260805 23:01:05.861876 31738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:05.950399 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 31572
I20260805 23:01:05.969586 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:36051
--local_ip_for_outbound_sockets=127.22.45.66
--tserver_master_addrs=127.22.45.126:39013
--webserver_port=42163
--webserver_interface=127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab
--principal=oryx/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:06.339922 32666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:06.340328 32666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:06.340476 32666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:06.351110 32666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:06.351272 32666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:06.351466 32666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:06.365535 32666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab
--principal=oryx/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:36051
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=42163
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:06.367152 32666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:06.368551 32666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:06.383226 32673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:06.383226 32674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:06.383450 32676 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:06.385169 32666 server_base.cc:1034] running on GCE node
I20260805 23:01:06.385887 32666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:06.386965 32666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:06.388200 32666 hybrid_clock.cc:648] HybridClock initialized: now 1785970866388141 us; error 53 us; skew 500 ppm
I20260805 23:01:06.388561 32666 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:06 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970866, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:06.392143 32666 init.cc:377] Logged in from keytab as oryx/127.22.45.66@KRBTEST.COM (short username oryx)
I20260805 23:01:06.393962 32666 webserver.cc:460] Webserver started at http://127.22.45.66:42163/ using document root <none> and password file <none>
I20260805 23:01:06.394797 32666 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:06.395020 32666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:06.401190 32666 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260805 23:01:06.404476 32685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:06.406260 32666 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260805 23:01:06.406482 32666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "cbca29ee5127477a8448fa55c04e180c"
format_stamp: "Formatted at 2026-08-05 23:01:02 on dist-test-slave-1vmg"
server_key: "eb43089943da8084d06c7697902de8ef"
server_key_iv: "a9802102b3cfd735e95c611978358495"
server_key_version: "encryptionkey@0"
I20260805 23:01:06.407743 32666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:06.426885 32666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:06.431797 32666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:06.432113 32666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:06.433252 32666 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:06.434824 32666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:06.434966 32666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:06.435086 32666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:06.435163 32666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:06.469436 32666 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:36051
I20260805 23:01:06.469561 382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:36051 every 8 connection(s)
I20260805 23:01:06.471611 32666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:06.476977 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 32666
I20260805 23:01:06.477365 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 31753
I20260805 23:01:06.498042 32465 catalog_manager.cc:1259] Loaded cluster ID: 7f0887d5ddcd4014a6505c81e0925320
I20260805 23:01:06.498209 32465 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: loading cluster ID for follower catalog manager: success
I20260805 23:01:06.502601 32465 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: acquiring CA information for follower catalog manager: success
I20260805 23:01:06.505930 32465 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
Aug 05 23:01:06 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.67@KRBTEST.COM
Aug 05 23:01:06 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970866, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.124@KRBTEST.COM
Aug 05 23:01:06 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970866, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
Aug 05 23:01:06 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970866, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.125@KRBTEST.COM
I20260805 23:01:06.544576 395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:06.479274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57284 (local address 127.22.45.67:46187)
0805 23:01:06.512275 (+ 33001us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:06.512288 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:06.513328 (+ 1040us) server_negotiation.cc:407] Connection header received
0805 23:01:06.513462 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:06.513474 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:06.513828 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:06.514066 (+ 238us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:06.517413 (+ 3347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.519414 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.521928 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.523185 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.523367 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:06.533601 (+ 10234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:06.533624 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:06.533645 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:06.533705 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:06.539278 (+ 5573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.540208 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.540218 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.540221 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.540414 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.540922 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.540927 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.540931 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.542141 (+ 1210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:06.542521 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:06.543847 (+ 1326us) server_negotiation.cc:299] Negotiation successful
0805 23:01:06.544158 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32771,"thread_start_us":32571,"threads_started":1}
I20260805 23:01:06.546104 31925 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:06.551771 389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:06.474898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:41539 (local address 127.22.45.126:39013)
0805 23:01:06.525393 (+ 50495us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:06.525400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:06.525423 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:01:06.525506 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:06.525512 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:06.525595 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:06.527643 (+ 2048us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:06.530169 (+ 2526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.531423 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.537467 (+ 6044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.538108 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.538252 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:06.544069 (+ 5817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:06.544077 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:06.544082 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:06.544128 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:06.547820 (+ 3692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.548592 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.548598 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.548601 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.548765 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.549264 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.549268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.549271 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.549651 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:06.549798 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:06.551140 (+ 1342us) server_negotiation.cc:299] Negotiation successful
0805 23:01:06.551401 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50351,"thread_start_us":50180,"threads_started":1}
I20260805 23:01:06.552995 392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:06.476673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.66:41539)
0805 23:01:06.496146 (+ 19473us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:06.496176 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:06.496346 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:06.527328 (+ 30982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:06.527333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:06.529569 (+ 2236us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:06.529920 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:06.529937 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.535283 (+ 5346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.535289 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:06.537210 (+ 1921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:06.537232 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.538320 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.538327 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:06.538592 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:06.539343 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:06.539366 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:06.543030 (+ 3664us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:06.547946 (+ 4916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:06.547951 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:06.547956 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:06.548469 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:06.548922 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:06.548928 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:06.548933 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:06.549131 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:06.549794 (+ 663us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:06.549804 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:06.550366 (+ 562us) client_negotiation.cc:769] Sending connection context
0805 23:01:06.550734 (+ 368us) client_negotiation.cc:240] Negotiation successful
0805 23:01:06.551389 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19308,"mutex_wait_us":31,"thread_start_us":17843,"threads_started":1}
I20260805 23:01:06.553031 393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:06.476012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.22.45.66:58489)
0805 23:01:06.490300 (+ 14288us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:06.490400 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:06.493851 (+ 3451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:06.526567 (+ 32716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:06.526573 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:06.527978 (+ 1405us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:06.529220 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:06.529257 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.531130 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.531136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:06.533389 (+ 2253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:06.533406 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.534970 (+ 1564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.534983 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:06.535487 (+ 504us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:06.536356 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:06.536395 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:06.539986 (+ 3591us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:06.544211 (+ 4225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:06.544222 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:06.544240 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:06.544848 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:06.545361 (+ 513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:06.545366 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:06.545370 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:06.546321 (+ 951us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:06.551820 (+ 5499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:06.551825 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:06.552022 (+ 197us) client_negotiation.cc:769] Sending connection context
0805 23:01:06.552170 (+ 148us) client_negotiation.cc:240] Negotiation successful
0805 23:01:06.552545 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13767,"mutex_wait_us":1,"thread_start_us":21960,"threads_started":1}
I20260805 23:01:06.553996 391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:06.475018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:58489 (local address 127.22.45.124:32851)
0805 23:01:06.526145 (+ 51127us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:06.526152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:06.526176 (+ 24us) server_negotiation.cc:407] Connection header received
0805 23:01:06.526242 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:06.526247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:06.526329 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:06.527412 (+ 1083us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:06.529467 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.530838 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.533746 (+ 2908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.534551 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.536010 (+ 1459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:06.540387 (+ 4377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:06.540394 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:06.540399 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:06.540446 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:06.544025 (+ 3579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.545021 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.545027 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.545031 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.545212 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.551257 (+ 6045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.551262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.551266 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.551658 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:06.553200 (+ 1542us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:06.553371 (+ 171us) server_negotiation.cc:299] Negotiation successful
0805 23:01:06.553657 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50969,"thread_start_us":50850,"threads_started":1}
I20260805 23:01:06.555555 383 heartbeater.cc:347] Connected to a master server at 127.22.45.124:32851
I20260805 23:01:06.555984 383 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:06.556468 396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:06.499002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:47809 (local address 127.22.45.125:44967)
0805 23:01:06.511588 (+ 12586us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:06.511597 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:06.524420 (+ 12823us) server_negotiation.cc:407] Connection header received
0805 23:01:06.524832 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:06.524839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:06.524935 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:06.525400 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:06.532543 (+ 7143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.533594 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.540437 (+ 6843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.541083 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.541203 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:06.545854 (+ 4651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:06.545859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:06.545862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:06.545898 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:06.549978 (+ 4080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.552166 (+ 2188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.552173 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.552176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.552341 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:06.553042 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:06.553048 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:06.553064 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:06.553550 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:06.553691 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:06.555202 (+ 1511us) server_negotiation.cc:299] Negotiation successful
0805 23:01:06.556148 (+ 946us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12392,"thread_start_us":12249,"threads_started":1}
I20260805 23:01:06.556732 384 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39013
I20260805 23:01:06.556866 397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:06.499010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.22.45.66:47809)
0805 23:01:06.524286 (+ 25276us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:06.524310 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:06.524639 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:06.526132 (+ 1493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:06.526149 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:06.531821 (+ 5672us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:06.532331 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:06.532348 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.533790 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.533795 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:06.540247 (+ 6452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:06.540263 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:06.541525 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:06.541531 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:06.541712 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:06.542281 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:06.542303 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:06.545619 (+ 3316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:06.550113 (+ 4494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:06.550118 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:06.550121 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:06.550792 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:06.552493 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:06.552498 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:06.552502 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:06.552654 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:06.554655 (+ 2001us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:06.554659 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:06.554855 (+ 196us) client_negotiation.cc:769] Sending connection context
0805 23:01:06.555042 (+ 187us) client_negotiation.cc:240] Negotiation successful
0805 23:01:06.555371 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25120,"mutex_wait_us":4890,"thread_start_us":24906,"threads_started":1}
I20260805 23:01:06.556905 384 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:06.558030 384 heartbeater.cc:511] Master 127.22.45.126:39013 requested a full tablet report, sending...
I20260805 23:01:06.558104 383 heartbeater.cc:511] Master 127.22.45.124:32851 requested a full tablet report, sending...
I20260805 23:01:06.559470 386 heartbeater.cc:347] Connected to a master server at 127.22.45.125:44967
I20260805 23:01:06.559635 386 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:06.560122 386 heartbeater.cc:511] Master 127.22.45.125:44967 requested a full tablet report, sending...
I20260805 23:01:06.560633 32401 ts_manager.cc:194] Registered new tserver with Master: cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051)
I20260805 23:01:06.560895 31303 ts_manager.cc:194] Re-registered known tserver with Master: cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051)
I20260805 23:01:06.561591 32139 ts_manager.cc:194] Registered new tserver with Master: cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051)
I20260805 23:01:06.561805 31303 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:41539
I20260805 23:01:06.644877 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 31753
I20260805 23:01:06.666455 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:46187
--local_ip_for_outbound_sockets=127.22.45.67
--tserver_master_addrs=127.22.45.126:39013
--webserver_port=39175
--webserver_interface=127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab
--principal=oryx/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:01:06.863505 32650 heartbeater.cc:503] Master 127.22.45.126:39013 was elected leader, sending a full tablet report...
W20260805 23:01:07.038424 401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:07.038802 401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:07.038962 401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:07.046888 401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:07.047137 401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:07.047305 401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:07.059028 401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab
--principal=oryx/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:46187
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=39175
--tserver_master_addrs=127.22.45.126:39013,127.22.45.125:44967,127.22.45.124:32851
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:07.060650 401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:07.062100 401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:07.077895 413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:07.077957 410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:07.078142 411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:07.080097 401 server_base.cc:1034] running on GCE node
I20260805 23:01:07.081007 401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:07.082546 401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:07.083846 401 hybrid_clock.cc:648] HybridClock initialized: now 1785970867083754 us; error 101 us; skew 500 ppm
I20260805 23:01:07.084259 401 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:07 dist-test-slave-1vmg krb5kdc[31243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970867, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:07.087873 401 init.cc:377] Logged in from keytab as oryx/127.22.45.67@KRBTEST.COM (short username oryx)
I20260805 23:01:07.089589 401 webserver.cc:460] Webserver started at http://127.22.45.67:39175/ using document root <none> and password file <none>
I20260805 23:01:07.090350 401 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:07.090498 401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:07.097069 401 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:01:07.100677 423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:07.102409 401 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:01:07.102638 401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "363a540217f5466f9606df810a3ba9ec"
format_stamp: "Formatted at 2026-08-05 23:01:03 on dist-test-slave-1vmg"
server_key: "ee26646c287224a634cdcd8c67732325"
server_key_iv: "1bd2daa7a633db69725423ff316e7903"
server_key_version: "encryptionkey@0"
I20260805 23:01:07.103991 401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:07.129523 401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:07.134824 401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:07.135217 401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:07.136356 401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:07.138070 401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:07.138187 401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:07.138301 401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:07.138375 401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:07.175704 401 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46187
I20260805 23:01:07.175783 575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46187 every 8 connection(s)
I20260805 23:01:07.177279 401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:07.185773 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 401
Aug 05 23:01:07 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970867, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.125@KRBTEST.COM
Aug 05 23:01:07 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970867, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.124@KRBTEST.COM
Aug 05 23:01:07 dist-test-slave-1vmg krb5kdc[31243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970867, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:07.224249 588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.182763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.22.45.67:39013)
0805 23:01:07.183351 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.183370 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.184503 (+ 1133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.185670 (+ 1167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.185675 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.186485 (+ 810us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:07.187487 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.187522 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.189089 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.189093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.191435 (+ 2342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.191456 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.192837 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.192843 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.193150 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.199048 (+ 5898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:07.199093 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:07.203346 (+ 4253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:07.218049 (+ 14703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:07.218056 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:07.218060 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:07.218777 (+ 717us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:07.219426 (+ 649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:07.219431 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:07.219435 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:07.219801 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:07.220592 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:07.220603 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:07.221188 (+ 585us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.221568 (+ 380us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.222309 (+ 741us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":203,"thread_start_us":323,"threads_started":1}
I20260805 23:01:07.224730 587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.180989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.22.45.67:58953)
0805 23:01:07.182059 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.182123 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.184474 (+ 2351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.185357 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.185369 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.186584 (+ 1215us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:07.187499 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.187519 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.189087 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.189093 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.192446 (+ 3353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.192463 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.198157 (+ 5694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.198166 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.198424 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.201118 (+ 2694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:07.201158 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:07.204859 (+ 3701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:07.220799 (+ 15940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:07.220805 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:07.220809 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:07.221447 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:07.221952 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:07.221957 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:07.221961 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:07.222148 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:07.222875 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:07.222880 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:07.223083 (+ 203us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.223219 (+ 136us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.223556 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":141,"spinlock_wait_cycles":92928,"thread_start_us":448,"threads_started":1}
I20260805 23:01:07.226341 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.180751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:58953 (local address 127.22.45.124:32851)
0805 23:01:07.181343 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.181347 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.182266 (+ 919us) server_negotiation.cc:407] Connection header received
0805 23:01:07.184951 (+ 2685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.184956 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.185050 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.185186 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.187766 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.188902 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.192657 (+ 3755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.193355 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.193473 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.207218 (+ 13745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.207227 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.207233 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.207293 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.220572 (+ 13279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.221616 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.221622 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.221626 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.221819 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.222284 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.222289 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.222292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.222661 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.222809 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.225446 (+ 2637us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.225765 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":381,"threads_started":1}
I20260805 23:01:07.226852 590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.182970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:39013 (local address 127.22.45.125:44967)
0805 23:01:07.183774 (+ 804us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.183778 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.183794 (+ 16us) server_negotiation.cc:407] Connection header received
0805 23:01:07.185390 (+ 1596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.185396 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.185475 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.186420 (+ 945us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.187739 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.188887 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.191668 (+ 2781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.192389 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.192542 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.203732 (+ 11190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.203741 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.203747 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.203797 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.217846 (+ 14049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.218989 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.218994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.218998 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.219267 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.220030 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.220035 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.220039 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.220426 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.225375 (+ 4949us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.226185 (+ 810us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.226492 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":605,"threads_started":1}
I20260805 23:01:07.228559 599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.194197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51984 (local address 127.22.45.126:39013)
0805 23:01:07.203810 (+ 9613us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.203816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.203837 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:01:07.203897 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.203902 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.203990 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.208607 (+ 4617us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.208864 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.210427 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.214149 (+ 3722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.215009 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.215160 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.219659 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.219666 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.219670 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.219783 (+ 113us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.223894 (+ 4111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.224975 (+ 1081us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.224981 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.224984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.225211 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.225739 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.225745 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.225749 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.226146 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.227802 (+ 1656us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.227948 (+ 146us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.228216 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9445,"spinlock_wait_cycles":34176,"thread_start_us":9782,"threads_started":1}
I20260805 23:01:07.228739 579 heartbeater.cc:347] Connected to a master server at 127.22.45.125:44967
I20260805 23:01:07.229130 579 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:07.229331 577 heartbeater.cc:347] Connected to a master server at 127.22.45.124:32851
I20260805 23:01:07.229485 577 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:07.230245 577 heartbeater.cc:511] Master 127.22.45.124:32851 requested a full tablet report, sending...
I20260805 23:01:07.231245 586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.180989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:40629)
0805 23:01:07.182059 (+ 1070us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.182123 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.184473 (+ 2350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.185355 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.185368 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.186472 (+ 1104us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:07.187487 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.187518 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.188904 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.188910 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.191644 (+ 2734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.191663 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.192601 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.192610 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.193073 (+ 463us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.200739 (+ 7666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:07.200767 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:07.210546 (+ 9779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:07.215886 (+ 5340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:07.215898 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:07.215922 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:07.216849 (+ 927us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:07.225954 (+ 9105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:07.225960 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:07.225963 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:07.227239 (+ 1276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:07.229917 (+ 2678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:07.229923 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:07.230146 (+ 223us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.230336 (+ 190us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.230725 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":733,"mutex_wait_us":153,"spinlock_wait_cycles":9600,"thread_start_us":457,"threads_started":1}
I20260805 23:01:07.231551 582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.180447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:40629 (local address 127.22.45.126:39013)
0805 23:01:07.180943 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.180950 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.182534 (+ 1584us) server_negotiation.cc:407] Connection header received
0805 23:01:07.184840 (+ 2306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.184846 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.184937 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.185031 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.187695 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.188709 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.191836 (+ 3127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.192322 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.192459 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.210778 (+ 18319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.210787 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.210793 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.210846 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.215693 (+ 4847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.219639 (+ 3946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.219651 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.219655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.219905 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.227440 (+ 7535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.227446 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.227449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.227926 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.228088 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.230598 (+ 2510us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.230888 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"spinlock_wait_cycles":9088,"thread_start_us":420,"threads_started":1}
I20260805 23:01:07.232239 579 heartbeater.cc:511] Master 127.22.45.125:44967 requested a full tablet report, sending...
I20260805 23:01:07.233067 578 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39013
I20260805 23:01:07.233230 578 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:07.233883 578 heartbeater.cc:511] Master 127.22.45.126:39013 requested a full tablet report, sending...
I20260805 23:01:07.234347 32139 ts_manager.cc:194] Registered new tserver with Master: 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187)
I20260805 23:01:07.235941 32401 ts_manager.cc:194] Registered new tserver with Master: 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187)
I20260805 23:01:07.236645 31303 ts_manager.cc:194] Re-registered known tserver with Master: 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187)
I20260805 23:01:07.237840 31303 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:40629
I20260805 23:01:07.235806 31300 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260805 23:01:07.247572 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.212555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59116 (local address 127.22.45.124:32851)
0805 23:01:07.229612 (+ 17057us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.229618 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.229638 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:01:07.229702 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.229708 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.229798 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.229910 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.232385 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.233932 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.236449 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.237298 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.237447 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.240969 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.240975 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.240978 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.241055 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.244132 (+ 3077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.244964 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.244969 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.244972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.245245 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.245748 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.245753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.245755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.246147 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.246416 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.246809 (+ 393us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.247123 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16880,"thread_start_us":22198,"threads_started":1}
W20260805 23:01:07.247898 31300 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:07.266028 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.194186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34250 (local address 127.22.45.125:44967)
0805 23:01:07.216414 (+ 22228us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.216421 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.216440 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:01:07.216502 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.216507 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.216608 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.216732 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.248198 (+ 31466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.249301 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.251374 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.252172 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.252347 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.256825 (+ 4478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.256833 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.256843 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.256907 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.261031 (+ 4124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.262216 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.262223 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.262228 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.262433 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.262988 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.262995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.262998 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.263409 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.265057 (+ 1648us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.265211 (+ 154us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.265500 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22073,"thread_start_us":22759,"threads_started":1}
I20260805 23:01:07.290345 623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.276823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53432 (local address 127.22.45.65:33525)
0805 23:01:07.277703 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.277719 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.279828 (+ 2109us) server_negotiation.cc:407] Connection header received
0805 23:01:07.282124 (+ 2296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.282134 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.282381 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.282610 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:07.283617 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.285044 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.287130 (+ 2086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.288454 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.288586 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.288829 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.289852 (+ 1023us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.290037 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":568,"thread_start_us":610,"threads_started":1}
I20260805 23:01:07.290695 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.281026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57286 (local address 127.22.45.67:46187)
0805 23:01:07.281899 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.281909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.281944 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:01:07.282055 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.282064 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.282388 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.282832 (+ 444us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:07.284053 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.285558 (+ 1505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.288112 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.289595 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.289731 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.289957 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.290212 (+ 255us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.290375 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":511,"threads_started":1}
I20260805 23:01:07.290819 625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.280662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46187 (local address 127.0.0.1:57286)
0805 23:01:07.281575 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.281608 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.281749 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.282787 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.282793 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.282847 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:07.283758 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.283777 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.285702 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.285708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.287929 (+ 2221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.287941 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.289830 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.289836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.290009 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.290042 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.290137 (+ 95us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.290278 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"mutex_wait_us":48,"thread_start_us":586,"threads_started":1}
I20260805 23:01:07.290884 624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.276403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53432)
0805 23:01:07.279648 (+ 3245us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.279674 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.281924 (+ 2250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.282602 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.282606 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.282635 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:07.283378 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.283392 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.285201 (+ 1809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.285207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.286890 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.286906 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.288969 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.288976 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.289165 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.289201 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.289290 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.289449 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3004,"mutex_wait_us":68,"thread_start_us":3792,"threads_started":1}
I20260805 23:01:07.292994 619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.276214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56146 (local address 127.22.45.66:36051)
0805 23:01:07.282404 (+ 6190us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.282412 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.282441 (+ 29us) server_negotiation.cc:407] Connection header received
0805 23:01:07.283584 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.283595 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.283894 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.284115 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:07.285765 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.287460 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.290075 (+ 2615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.291881 (+ 1806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.292029 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.292256 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.292636 (+ 380us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.292778 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6024,"thread_start_us":5909,"threads_started":1}
I20260805 23:01:07.293080 621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.277297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36051 (local address 127.0.0.1:56146)
0805 23:01:07.281800 (+ 4503us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.281821 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.282490 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.284647 (+ 2157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.284651 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.284677 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:07.285079 (+ 402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.285092 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.287638 (+ 2546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.287644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.289815 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.289829 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.292217 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.292225 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.292419 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.292454 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.292570 (+ 116us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.292715 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3089,"thread_start_us":1910,"threads_started":1}
I20260805 23:01:07.295537 32560 tablet_service.cc:1467] Processing CreateTablet for tablet dd603b0e6585446490d7fffdb7f26350 (DEFAULT_TABLE table=test-table [id=620cc03266e1468385869947de74b8ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:07.296345 32758 tablet_service.cc:1467] Processing CreateTablet for tablet dd603b0e6585446490d7fffdb7f26350 (DEFAULT_TABLE table=test-table [id=620cc03266e1468385869947de74b8ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:07.296854 32560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd603b0e6585446490d7fffdb7f26350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:07.297477 32758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd603b0e6585446490d7fffdb7f26350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:07.305387 489 tablet_service.cc:1467] Processing CreateTablet for tablet dd603b0e6585446490d7fffdb7f26350 (DEFAULT_TABLE table=test-table [id=620cc03266e1468385869947de74b8ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:07.306658 489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd603b0e6585446490d7fffdb7f26350. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:07.312471 627 tablet_bootstrap.cc:492] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Bootstrap starting.
I20260805 23:01:07.316330 629 tablet_bootstrap.cc:492] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Bootstrap starting.
I20260805 23:01:07.317489 627 tablet_bootstrap.cc:654] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:07.319062 627 log.cc:824] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:07.320684 629 tablet_bootstrap.cc:654] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:07.322161 629 log.cc:824] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:07.323220 627 tablet_bootstrap.cc:492] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: No bootstrap required, opened a new log
I20260805 23:01:07.323530 627 ts_tablet_manager.cc:1397] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260805 23:01:07.325029 634 tablet_bootstrap.cc:492] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Bootstrap starting.
I20260805 23:01:07.329236 629 tablet_bootstrap.cc:492] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: No bootstrap required, opened a new log
I20260805 23:01:07.329819 629 ts_tablet_manager.cc:1397] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260805 23:01:07.331321 634 tablet_bootstrap.cc:654] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:07.332842 634 log.cc:824] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:07.334982 627 raft_consensus.cc:348] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.335538 627 raft_consensus.cc:374] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:07.335665 627 raft_consensus.cc:729] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbca29ee5127477a8448fa55c04e180c, State: Initialized, Role: FOLLOWER
I20260805 23:01:07.336362 627 consensus_queue.cc:260] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.338341 627 ts_tablet_manager.cc:1428] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260805 23:01:07.338634 384 heartbeater.cc:503] Master 127.22.45.126:39013 was elected leader, sending a full tablet report...
I20260805 23:01:07.346488 629 raft_consensus.cc:348] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.347162 629 raft_consensus.cc:374] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:07.347304 629 raft_consensus.cc:729] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fc6712346d34d52ac512258e82813d0, State: Initialized, Role: FOLLOWER
I20260805 23:01:07.348639 629 consensus_queue.cc:260] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.350984 629 ts_tablet_manager.cc:1428] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Time spent starting tablet: real 0.021s user 0.009s sys 0.009s
I20260805 23:01:07.352649 634 tablet_bootstrap.cc:492] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: No bootstrap required, opened a new log
I20260805 23:01:07.353706 634 ts_tablet_manager.cc:1397] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Time spent bootstrapping tablet: real 0.028s user 0.014s sys 0.008s
I20260805 23:01:07.365559 634 raft_consensus.cc:348] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.366184 634 raft_consensus.cc:374] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:07.366302 634 raft_consensus.cc:729] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363a540217f5466f9606df810a3ba9ec, State: Initialized, Role: FOLLOWER
I20260805 23:01:07.366986 634 consensus_queue.cc:260] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.368255 578 heartbeater.cc:503] Master 127.22.45.126:39013 was elected leader, sending a full tablet report...
I20260805 23:01:07.368930 634 ts_tablet_manager.cc:1428] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Time spent starting tablet: real 0.015s user 0.011s sys 0.003s
I20260805 23:01:07.417363 639 raft_consensus.cc:482] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:07.417718 639 raft_consensus.cc:504] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.419807 639 leader_election.cc:288] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051), 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187)
I20260805 23:01:07.427786 626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.420458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:34191 (local address 127.22.45.67:46187)
0805 23:01:07.420700 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.420707 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.421453 (+ 746us) server_negotiation.cc:407] Connection header received
0805 23:01:07.421637 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.421642 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.421704 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.421780 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:07.422456 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.423255 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.425488 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.426854 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.427114 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.427199 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.427450 (+ 251us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.427565 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:01:07.428028 645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.420128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46187 (local address 127.22.45.65:34191)
0805 23:01:07.421333 (+ 1205us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.421348 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.421502 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.421818 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.421823 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.421860 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:07.422294 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.422305 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.423391 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.423395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.425298 (+ 1903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.425315 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.427131 (+ 1816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.427137 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.427270 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.427306 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.427421 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.427597 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1084,"mutex_wait_us":66,"spinlock_wait_cycles":8448,"thread_start_us":935,"threads_started":1}
I20260805 23:01:07.428460 644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.420084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36051 (local address 127.22.45.65:47753)
0805 23:01:07.421283 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:07.421306 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:07.421492 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:07.421818 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:07.421823 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:07.421857 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:07.422307 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.422318 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.423501 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.423506 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.425636 (+ 2130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:07.425651 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.427455 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.427462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:07.427624 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.427653 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 23:01:07.427757 (+ 104us) client_negotiation.cc:240] Negotiation successful
0805 23:01:07.427890 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1063,"mutex_wait_us":48,"spinlock_wait_cycles":6912,"thread_start_us":634,"threads_started":1}
I20260805 23:01:07.428529 619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.420210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:47753 (local address 127.22.45.66:36051)
0805 23:01:07.420448 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.420455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.421425 (+ 970us) server_negotiation.cc:407] Connection header received
0805 23:01:07.421632 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.421636 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.421701 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.421782 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:07.422457 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.423363 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.425877 (+ 2514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.427185 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.427323 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.427374 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.427800 (+ 426us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.428197 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 23:01:07.429168 513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd603b0e6585446490d7fffdb7f26350" candidate_uuid: "1fc6712346d34d52ac512258e82813d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a540217f5466f9606df810a3ba9ec" is_pre_election: true
I20260805 23:01:07.429602 315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd603b0e6585446490d7fffdb7f26350" candidate_uuid: "1fc6712346d34d52ac512258e82813d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbca29ee5127477a8448fa55c04e180c" is_pre_election: true
I20260805 23:01:07.429822 513 raft_consensus.cc:2454] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fc6712346d34d52ac512258e82813d0 in term 0.
I20260805 23:01:07.430146 315 raft_consensus.cc:2454] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fc6712346d34d52ac512258e82813d0 in term 0.
W20260805 23:01:07.430281 581 tablet.cc:2369] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:07.430824 32500 leader_election.cc:302] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fc6712346d34d52ac512258e82813d0, cbca29ee5127477a8448fa55c04e180c; no voters:
I20260805 23:01:07.431366 639 raft_consensus.cc:2781] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:07.431514 639 raft_consensus.cc:482] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:07.431663 639 raft_consensus.cc:3037] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:07.434643 639 raft_consensus.cc:504] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.435344 639 leader_election.cc:288] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [CANDIDATE]: Term 1 election: Requested vote from peers cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051), 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187)
I20260805 23:01:07.436311 513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd603b0e6585446490d7fffdb7f26350" candidate_uuid: "1fc6712346d34d52ac512258e82813d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363a540217f5466f9606df810a3ba9ec"
I20260805 23:01:07.436461 315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd603b0e6585446490d7fffdb7f26350" candidate_uuid: "1fc6712346d34d52ac512258e82813d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbca29ee5127477a8448fa55c04e180c"
I20260805 23:01:07.436612 513 raft_consensus.cc:3037] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:07.436805 315 raft_consensus.cc:3037] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:07.440282 513 raft_consensus.cc:2454] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fc6712346d34d52ac512258e82813d0 in term 1.
I20260805 23:01:07.440282 315 raft_consensus.cc:2454] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fc6712346d34d52ac512258e82813d0 in term 1.
I20260805 23:01:07.440904 32498 leader_election.cc:302] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fc6712346d34d52ac512258e82813d0, 363a540217f5466f9606df810a3ba9ec; no voters:
I20260805 23:01:07.441291 639 raft_consensus.cc:2781] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:07.442113 639 raft_consensus.cc:686] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 1 LEADER]: Becoming Leader. State: Replica: 1fc6712346d34d52ac512258e82813d0, State: Running, Role: LEADER
I20260805 23:01:07.442732 639 consensus_queue.cc:237] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:07.448246 31303 catalog_manager.cc:5495] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1fc6712346d34d52ac512258e82813d0 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "1fc6712346d34d52ac512258e82813d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } health_report { overall_health: UNKNOWN } } }
W20260805 23:01:07.481187 388 tablet.cc:2369] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:07.487534 623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.479946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53446 (local address 127.22.45.65:33525)
0805 23:01:07.480198 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.480205 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.480301 (+ 96us) server_negotiation.cc:407] Connection header received
0805 23:01:07.480526 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.480531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.480644 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.480836 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:07.481648 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.482749 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.484908 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.485397 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.485524 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.486211 (+ 687us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:07.486827 (+ 616us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:07.487011 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.487135 (+ 124us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.487241 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260805 23:01:07.498180 315 raft_consensus.cc:1261] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Refusing update from remote peer 1fc6712346d34d52ac512258e82813d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:07.498157 513 raft_consensus.cc:1261] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 1 FOLLOWER]: Refusing update from remote peer 1fc6712346d34d52ac512258e82813d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:07.499437 646 consensus_queue.cc:1035] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:07.500154 639 consensus_queue.cc:1035] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:07.530040 654 mvcc.cc:205] Tried to move back new op lower bound from 7315336673259790336 to 7315336673049968640. Current Snapshot: MvccSnapshot[applied={T|T < 7315336673259790336}]
I20260805 23:01:07.530669 652 mvcc.cc:205] Tried to move back new op lower bound from 7315336673259790336 to 7315336673049968640. Current Snapshot: MvccSnapshot[applied={T|T < 7315336673259790336}]
I20260805 23:01:07.552675 31300 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:07.552979 31300 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:07.561820 31300 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c3ec687b45824a42bf59b08238d53e0b: Sending DeleteTablet for 3 replicas of tablet dd603b0e6585446490d7fffdb7f26350
I20260805 23:01:07.563241 32758 tablet_service.cc:1514] Processing DeleteTablet for tablet dd603b0e6585446490d7fffdb7f26350 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:07 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:56146
I20260805 23:01:07.564334 668 tablet_replica.cc:330] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: stopping tablet replica
I20260805 23:01:07.564749 668 raft_consensus.cc:2229] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:07.565290 668 raft_consensus.cc:2258] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:07.567643 32560 tablet_service.cc:1514] Processing DeleteTablet for tablet dd603b0e6585446490d7fffdb7f26350 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:07 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:53432
I20260805 23:01:07.568792 489 tablet_service.cc:1514] Processing DeleteTablet for tablet dd603b0e6585446490d7fffdb7f26350 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:07 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:57286
I20260805 23:01:07.576320 668 ts_tablet_manager.cc:1905] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:07.586434 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 31262
I20260805 23:01:07.588027 31354 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:07.588959 670 tablet_replica.cc:330] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: stopping tablet replica
I20260805 23:01:07.589984 670 raft_consensus.cc:2229] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:07.590831 670 raft_consensus.cc:2258] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:07.591873 669 tablet_replica.cc:330] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: stopping tablet replica
I20260805 23:01:07.592393 669 raft_consensus.cc:2229] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:01:07.593080 669 raft_consensus.cc:2258] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:07.594895 670 ts_tablet_manager.cc:1905] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:07.596092 668 ts_tablet_manager.cc:1918] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:07.596305 668 log.cc:1196] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/dd603b0e6585446490d7fffdb7f26350
I20260805 23:01:07.596975 668 ts_tablet_manager.cc:1939] T dd603b0e6585446490d7fffdb7f26350 P cbca29ee5127477a8448fa55c04e180c: Deleting consensus metadata
I20260805 23:01:07.602545 670 ts_tablet_manager.cc:1918] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:07.602746 670 log.cc:1196] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/dd603b0e6585446490d7fffdb7f26350
I20260805 23:01:07.603366 670 ts_tablet_manager.cc:1939] T dd603b0e6585446490d7fffdb7f26350 P 363a540217f5466f9606df810a3ba9ec: Deleting consensus metadata
I20260805 23:01:07.606777 669 ts_tablet_manager.cc:1905] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:07.611925 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.570447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34256 (local address 127.22.45.125:44967)
0805 23:01:07.570659 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.570666 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.584724 (+ 14058us) server_negotiation.cc:407] Connection header received
0805 23:01:07.585938 (+ 1214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.585945 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.586048 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.586118 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.592703 (+ 6585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.593823 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.598541 (+ 4718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.599222 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.599354 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.604028 (+ 4674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.604036 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.604041 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.604088 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.608125 (+ 4037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.609185 (+ 1060us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.609191 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.609194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.609370 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.609892 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.609898 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.609901 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.610345 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.610622 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.611323 (+ 701us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.611589 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:01:07.617873 669 ts_tablet_manager.cc:1918] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:07.618412 669 log.cc:1196] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/dd603b0e6585446490d7fffdb7f26350
I20260805 23:01:07.619544 669 ts_tablet_manager.cc:1939] T dd603b0e6585446490d7fffdb7f26350 P 1fc6712346d34d52ac512258e82813d0: Deleting consensus metadata
I20260805 23:01:07.629563 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.585430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.22.45.124:32851)
0805 23:01:07.585631 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.585636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.612992 (+ 27356us) server_negotiation.cc:407] Connection header received
0805 23:01:07.613358 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.613364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.613454 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.613526 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.615599 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.616747 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.619216 (+ 2469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.619871 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.619984 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.623449 (+ 3465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.623455 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.623459 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.623501 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.626313 (+ 2812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.627492 (+ 1179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.627496 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.627498 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.627654 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.628034 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.628038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.628040 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.628361 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.628628 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.628972 (+ 344us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.629221 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 23:01:07.751924 31283 catalog_manager.cc:4841] TS cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051): tablet dd603b0e6585446490d7fffdb7f26350 (table test-table [id=620cc03266e1468385869947de74b8ed]) successfully deleted
I20260805 23:01:07.752010 31282 catalog_manager.cc:4841] TS 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525): tablet dd603b0e6585446490d7fffdb7f26350 (table test-table [id=620cc03266e1468385869947de74b8ed]) successfully deleted
I20260805 23:01:07.752542 31282 catalog_manager.cc:4841] TS 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187): tablet dd603b0e6585446490d7fffdb7f26350 (table test-table [id=620cc03266e1468385869947de74b8ed]) successfully deleted
I20260805 23:01:07.753014 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 31262
I20260805 23:01:07.802263 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.785183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59130 (local address 127.22.45.124:32851)
0805 23:01:07.785421 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.785427 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.785447 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:01:07.785506 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.785511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.785596 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.785719 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.787987 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.789140 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.790968 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.791503 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.791635 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.795420 (+ 3785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.795427 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.795433 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.795492 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.799186 (+ 3694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.799968 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.799975 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.799979 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.800126 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.800600 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.800605 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.800609 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.800943 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.801224 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.801554 (+ 330us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.801808 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 23:01:07.802459 601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:07.783592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34260 (local address 127.22.45.125:44967)
0805 23:01:07.783804 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:07.783810 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:07.784896 (+ 1086us) server_negotiation.cc:407] Connection header received
0805 23:01:07.785194 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:07.785200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:07.785293 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:07.785364 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:07.788045 (+ 2681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.788836 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.790726 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:07.791436 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:07.791596 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:07.795508 (+ 3912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:07.795514 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:07.795517 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:07.795557 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:07.798593 (+ 3036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.799617 (+ 1024us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.799623 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.799627 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.799820 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:07.800580 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:07.800586 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:07.800589 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:07.800991 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:07.801235 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:07.801831 (+ 596us) server_negotiation.cc:299] Negotiation successful
0805 23:01:07.802094 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260805 23:01:08.541461 682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:08.540555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.66:48633)
0805 23:01:08.541064 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:08.541254 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":248,"threads_started":1}
W20260805 23:01:08.541987 384 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:39013 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
I20260805 23:01:08.545245 683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:08.544328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.65:57681)
0805 23:01:08.544844 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:08.545001 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":275,"threads_started":1}
W20260805 23:01:08.545683 32650 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:39013 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
I20260805 23:01:08.547340 685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:08.546524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:55673)
0805 23:01:08.547025 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:08.547163 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":251,"threads_started":1}
W20260805 23:01:08.547701 578 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:39013 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
I20260805 23:01:09.061183 686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c3ec687b45824a42bf59b08238d53e0b)
I20260805 23:01:09.061506 686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } }
I20260805 23:01:09.062006 688 raft_consensus.cc:482] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c3ec687b45824a42bf59b08238d53e0b)
I20260805 23:01:09.062250 688 raft_consensus.cc:504] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } }
I20260805 23:01:09.063098 686 leader_election.cc:288] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3ec687b45824a42bf59b08238d53e0b (127.22.45.126:39013), 990bc9188b314b7094f785f00dfb708f (127.22.45.125:44967)
I20260805 23:01:09.063614 688 leader_election.cc:288] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c3ec687b45824a42bf59b08238d53e0b (127.22.45.126:39013), 75b857da4ff940f49befbfeab8e7a904 (127.22.45.124:32851)
I20260805 23:01:09.077244 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.063297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52404)
0805 23:01:09.076106 (+ 12809us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.076471 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12596,"threads_started":1}
W20260805 23:01:09.077694 32376 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
I20260805 23:01:09.087139 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.086502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52420)
0805 23:01:09.086784 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.086886 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":160}
I20260805 23:01:09.087268 696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.078148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52416)
0805 23:01:09.086665 (+ 8517us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.086946 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8360,"thread_start_us":7139,"threads_started":1}
W20260805 23:01:09.087736 32376 leader_election.cc:334] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c3ec687b45824a42bf59b08238d53e0b (127.22.45.126:39013): Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
W20260805 23:01:09.087733 32117 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
I20260805 23:01:09.088601 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.063336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:44967 (local address 127.0.0.1:34270)
0805 23:01:09.077462 (+ 14126us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.077482 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:09.077780 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:09.078627 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:09.078633 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:09.078671 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:09.079028 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.079043 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.081418 (+ 2375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.081426 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.084939 (+ 3513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.084966 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.087672 (+ 2706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.087679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.087903 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.087971 (+ 68us) client_negotiation.cc:769] Sending connection context
0805 23:01:09.088067 (+ 96us) client_negotiation.cc:240] Negotiation successful
0805 23:01:09.088216 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13994,"thread_start_us":13596,"threads_started":1}
I20260805 23:01:09.089207 691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.063547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34270 (local address 127.22.45.125:44967)
0805 23:01:09.077964 (+ 14417us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.078020 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.078042 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:01:09.078128 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.078133 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.078222 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.078339 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:09.079294 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.081128 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.085227 (+ 4099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.087190 (+ 1963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.087470 (+ 280us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.087580 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.088218 (+ 638us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.088380 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14286,"thread_start_us":14047,"threads_started":1}
I20260805 23:01:09.090277 32153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75b857da4ff940f49befbfeab8e7a904" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "990bc9188b314b7094f785f00dfb708f" is_pre_election: true
I20260805 23:01:09.090675 32153 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75b857da4ff940f49befbfeab8e7a904 in term 1.
I20260805 23:01:09.090962 696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.090477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52430)
0805 23:01:09.090682 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.090783 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260805 23:01:09.091190 32117 leader_election.cc:334] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c3ec687b45824a42bf59b08238d53e0b (127.22.45.126:39013): Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
I20260805 23:01:09.091315 32378 leader_election.cc:302] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75b857da4ff940f49befbfeab8e7a904, 990bc9188b314b7094f785f00dfb708f; no voters: c3ec687b45824a42bf59b08238d53e0b
I20260805 23:01:09.092144 686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260805 23:01:09.092304 686 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c3ec687b45824a42bf59b08238d53e0b)
I20260805 23:01:09.092409 686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 1 FOLLOWER]: Advancing to term 2
I20260805 23:01:09.093268 694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.064144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59140 (local address 127.22.45.124:32851)
0805 23:01:09.076865 (+ 12721us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.076873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.083731 (+ 6858us) server_negotiation.cc:407] Connection header received
0805 23:01:09.084370 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.084379 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.084476 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.084556 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:09.086403 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.087803 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.090427 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.091690 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.091847 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.092101 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.092694 (+ 593us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.092859 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12560,"thread_start_us":12749,"threads_started":1}
I20260805 23:01:09.093962 692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.063791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32851 (local address 127.0.0.1:59140)
0805 23:01:09.083556 (+ 19765us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.083597 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:09.084150 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:09.084904 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:09.084910 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:09.084955 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:09.086143 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.086157 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.088006 (+ 1849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.088011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.090204 (+ 2193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.090222 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.092253 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.092260 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.092453 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.092491 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 23:01:09.093468 (+ 977us) client_negotiation.cc:240] Negotiation successful
0805 23:01:09.093649 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19583,"thread_start_us":19982,"threads_started":1}
I20260805 23:01:09.094798 32413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "990bc9188b314b7094f785f00dfb708f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "75b857da4ff940f49befbfeab8e7a904" is_pre_election: true
I20260805 23:01:09.095798 686 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } }
I20260805 23:01:09.096383 32413 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 990bc9188b314b7094f785f00dfb708f in current term 2: Already voted for candidate 75b857da4ff940f49befbfeab8e7a904 in this term.
I20260805 23:01:09.096648 686 leader_election.cc:288] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [CANDIDATE]: Term 2 election: Requested vote from peers c3ec687b45824a42bf59b08238d53e0b (127.22.45.126:39013), 990bc9188b314b7094f785f00dfb708f (127.22.45.125:44967)
I20260805 23:01:09.097334 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.096824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52446)
0805 23:01:09.097049 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.097175 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260805 23:01:09.097536 32118 leader_election.cc:302] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 990bc9188b314b7094f785f00dfb708f; no voters: 75b857da4ff940f49befbfeab8e7a904, c3ec687b45824a42bf59b08238d53e0b
I20260805 23:01:09.097823 32153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "75b857da4ff940f49befbfeab8e7a904" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "990bc9188b314b7094f785f00dfb708f"
I20260805 23:01:09.098084 688 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 1 FOLLOWER]: Advancing to term 2
I20260805 23:01:09.099762 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.099272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52450)
0805 23:01:09.099477 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.099592 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260805 23:01:09.099989 32376 leader_election.cc:334] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c3ec687b45824a42bf59b08238d53e0b (127.22.45.126:39013): Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
I20260805 23:01:09.100881 688 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260805 23:01:09.103416 32153 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75b857da4ff940f49befbfeab8e7a904 in term 2.
I20260805 23:01:09.104578 32378 leader_election.cc:302] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 75b857da4ff940f49befbfeab8e7a904, 990bc9188b314b7094f785f00dfb708f; no voters: c3ec687b45824a42bf59b08238d53e0b
I20260805 23:01:09.105129 686 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 23:01:09.105792 686 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [term 2 LEADER]: Becoming Leader. State: Replica: 75b857da4ff940f49befbfeab8e7a904, State: Running, Role: LEADER
I20260805 23:01:09.106236 686 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } }
I20260805 23:01:09.108279 701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75b857da4ff940f49befbfeab8e7a904. Latest consensus state: current_term: 2 leader_uuid: "75b857da4ff940f49befbfeab8e7a904" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:09.108826 701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:09.109578 703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:09.113611 703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:09.114607 703 catalog_manager.cc:1259] Loaded cluster ID: 7f0887d5ddcd4014a6505c81e0925320
I20260805 23:01:09.114694 703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:09.116031 703 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:09.116951 703 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Loaded TSK: 0
I20260805 23:01:09.117914 703 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:01:09.156273 32399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:01:09.164444 32399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:09.169502 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.169020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52458)
0805 23:01:09.169178 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.169294 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260805 23:01:09.169627 32153 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [term 2 FOLLOWER]: Refusing update from remote peer 75b857da4ff940f49befbfeab8e7a904: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260805 23:01:09.170641 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.170220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52468)
0805 23:01:09.170427 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.170503 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260805 23:01:09.170553 701 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [LEADER]: Connected to new peer: Peer: permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260805 23:01:09.170840 32376 consensus_peers.cc:487] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 -> Peer c3ec687b45824a42bf59b08238d53e0b (127.22.45.126:39013): Couldn't send request to peer c3ec687b45824a42bf59b08238d53e0b. Status: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260805 23:01:09.173596 688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75b857da4ff940f49befbfeab8e7a904. Latest consensus state: current_term: 2 leader_uuid: "75b857da4ff940f49befbfeab8e7a904" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:09.173919 688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:01:09.176734 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "75b857da4ff940f49befbfeab8e7a904" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:09.177511 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904 [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:09.178079 688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "75b857da4ff940f49befbfeab8e7a904" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "c3ec687b45824a42bf59b08238d53e0b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39013 } } peers { permanent_uuid: "990bc9188b314b7094f785f00dfb708f" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 44967 } attrs { promote: false } } peers { permanent_uuid: "75b857da4ff940f49befbfeab8e7a904" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32851 } attrs { promote: false } } }
I20260805 23:01:09.178385 688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 990bc9188b314b7094f785f00dfb708f [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:01:09.195326 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.186438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53454)
0805 23:01:09.186581 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.186598 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:09.186697 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:09.187709 (+ 1012us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:09.187713 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:09.187742 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:09.187947 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.187961 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.189535 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.189542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.191648 (+ 2106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.191673 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.194305 (+ 2632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.194314 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.194577 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.194629 (+ 52us) client_negotiation.cc:769] Sending connection context
0805 23:01:09.194727 (+ 98us) client_negotiation.cc:240] Negotiation successful
0805 23:01:09.194935 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260805 23:01:09.197016 712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.186623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53454 (local address 127.22.45.65:33525)
0805 23:01:09.187315 (+ 692us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.187321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.187341 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:01:09.187417 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.187422 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.187504 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.187673 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:09.188124 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.189321 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.191970 (+ 2649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.194005 (+ 2035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.196228 (+ 2223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.196367 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.196438 (+ 71us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.196629 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":309,"threads_started":1}
I20260805 23:01:09.200491 32560 tablet_service.cc:1467] Processing CreateTablet for tablet f3c7a6e2e2d14963be871bce495d7ede (DEFAULT_TABLE table=test-table [id=901d19c84250432a8c1bcb5154be4f66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:09.201100 32560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c7a6e2e2d14963be871bce495d7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:09.206986 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.187227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36051 (local address 127.0.0.1:56158)
0805 23:01:09.187373 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.187391 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:09.187500 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:09.201454 (+ 13954us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:09.201459 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:09.201488 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:09.201753 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.201763 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.203263 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.203270 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.204872 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.204885 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.206107 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.206114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.206312 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.206354 (+ 42us) client_negotiation.cc:769] Sending connection context
0805 23:01:09.206462 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 23:01:09.206623 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47,"mutex_wait_us":1}
I20260805 23:01:09.207262 689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.188043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46187 (local address 127.0.0.1:57292)
0805 23:01:09.195764 (+ 7721us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.195795 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:09.195989 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:09.200209 (+ 4220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:09.200215 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:09.200245 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:09.200474 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.200489 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.201974 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.201979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.203928 (+ 1949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.203945 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.206240 (+ 2295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.206246 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.206478 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.206519 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 23:01:09.206593 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 23:01:09.206699 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7493,"mutex_wait_us":29,"thread_start_us":11138,"threads_started":1}
I20260805 23:01:09.207459 715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.188226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57292 (local address 127.22.45.67:46187)
0805 23:01:09.199810 (+ 11584us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.199816 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.199836 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:01:09.199917 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.199923 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.200017 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.200637 (+ 620us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:09.200835 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.201846 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.204342 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.206049 (+ 1707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.206211 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.206325 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.206996 (+ 671us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.207176 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11426,"thread_start_us":11323,"threads_started":1}
I20260805 23:01:09.208525 716 tablet_bootstrap.cc:492] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: Bootstrap starting.
I20260805 23:01:09.208400 489 tablet_service.cc:1467] Processing CreateTablet for tablet f3c7a6e2e2d14963be871bce495d7ede (DEFAULT_TABLE table=test-table [id=901d19c84250432a8c1bcb5154be4f66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:09.208546 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.187251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56158 (local address 127.22.45.66:36051)
0805 23:01:09.200999 (+ 13748us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.201005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.201024 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:01:09.201088 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.201092 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.201151 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.201414 (+ 263us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:09.201906 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.203087 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.205061 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.205844 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.205965 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.206096 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.208047 (+ 1951us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.208250 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13625,"thread_start_us":14003,"threads_started":1}
I20260805 23:01:09.208948 489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c7a6e2e2d14963be871bce495d7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:09.209416 32758 tablet_service.cc:1467] Processing CreateTablet for tablet f3c7a6e2e2d14963be871bce495d7ede (DEFAULT_TABLE table=test-table [id=901d19c84250432a8c1bcb5154be4f66]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:09.209893 32758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3c7a6e2e2d14963be871bce495d7ede. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:09.213253 716 tablet_bootstrap.cc:654] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:09.219018 722 tablet_bootstrap.cc:492] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: Bootstrap starting.
I20260805 23:01:09.219892 721 tablet_bootstrap.cc:492] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: Bootstrap starting.
I20260805 23:01:09.220674 716 tablet_bootstrap.cc:492] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: No bootstrap required, opened a new log
I20260805 23:01:09.220860 716 ts_tablet_manager.cc:1397] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260805 23:01:09.220933 722 tablet_bootstrap.cc:654] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:09.221764 721 tablet_bootstrap.cc:654] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:09.221804 716 raft_consensus.cc:348] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.222067 716 raft_consensus.cc:374] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:09.222186 716 raft_consensus.cc:729] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fc6712346d34d52ac512258e82813d0, State: Initialized, Role: FOLLOWER
I20260805 23:01:09.222498 716 consensus_queue.cc:260] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.224277 716 ts_tablet_manager.cc:1428] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260805 23:01:09.225066 722 tablet_bootstrap.cc:492] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: No bootstrap required, opened a new log
I20260805 23:01:09.225250 722 ts_tablet_manager.cc:1397] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260805 23:01:09.225975 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.224145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.65:58585)
0805 23:01:09.225515 (+ 1370us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.225719 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":822,"thread_start_us":643,"threads_started":1}
I20260805 23:01:09.226164 722 raft_consensus.cc:348] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.226455 722 raft_consensus.cc:374] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:09.226576 722 raft_consensus.cc:729] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbca29ee5127477a8448fa55c04e180c, State: Initialized, Role: FOLLOWER
I20260805 23:01:09.226835 722 consensus_queue.cc:260] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.227299 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.226806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.65:53563)
0805 23:01:09.227022 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.227121 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260805 23:01:09.227491 32649 heartbeater.cc:503] Master 127.22.45.124:32851 was elected leader, sending a full tablet report...
I20260805 23:01:09.231694 722 ts_tablet_manager.cc:1428] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260805 23:01:09.232095 721 tablet_bootstrap.cc:492] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: No bootstrap required, opened a new log
I20260805 23:01:09.232298 721 ts_tablet_manager.cc:1397] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.004s
I20260805 23:01:09.233243 721 raft_consensus.cc:348] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.233546 721 raft_consensus.cc:374] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:09.233652 721 raft_consensus.cc:729] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363a540217f5466f9606df810a3ba9ec, State: Initialized, Role: FOLLOWER
I20260805 23:01:09.233963 734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.232464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.66:36069)
0805 23:01:09.233436 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.233627 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":811,"thread_start_us":656,"threads_started":1}
I20260805 23:01:09.233986 721 consensus_queue.cc:260] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.234404 383 heartbeater.cc:503] Master 127.22.45.124:32851 was elected leader, sending a full tablet report...
I20260805 23:01:09.239666 734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.234710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.66:41049)
0805 23:01:09.239304 (+ 4594us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.239444 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4455,"threads_started":1}
I20260805 23:01:09.244005 721 ts_tablet_manager.cc:1428] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: Time spent starting tablet: real 0.012s user 0.010s sys 0.003s
I20260805 23:01:09.245384 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.244318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:45923)
0805 23:01:09.244927 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.245088 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":308,"threads_started":1}
I20260805 23:01:09.246313 577 heartbeater.cc:503] Master 127.22.45.124:32851 was elected leader, sending a full tablet report...
I20260805 23:01:09.246662 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.246248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:58453)
0805 23:01:09.246413 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.246509 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260805 23:01:09.247998 735 raft_consensus.cc:482] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:09.248271 735 raft_consensus.cc:504] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.249814 735 leader_election.cc:288] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525), cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051)
I20260805 23:01:09.258391 741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.250068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.22.45.67:56349)
0805 23:01:09.250503 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.250523 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:09.250764 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:09.251183 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:09.251186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:09.251206 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:09.251508 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.251521 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.252879 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.252884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.255314 (+ 2430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.255333 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.257308 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.257321 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.257581 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.257690 (+ 109us) client_negotiation.cc:769] Sending connection context
0805 23:01:09.257808 (+ 118us) client_negotiation.cc:240] Negotiation successful
0805 23:01:09.258018 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"mutex_wait_us":142}
I20260805 23:01:09.258504 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.250361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:33209 (local address 127.22.45.66:36051)
0805 23:01:09.250604 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.250610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.250885 (+ 275us) server_negotiation.cc:407] Connection header received
0805 23:01:09.251067 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.251072 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.251168 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.251259 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:09.251788 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.252814 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.255505 (+ 2691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.256805 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.257003 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.257091 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.257862 (+ 771us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.258219 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 23:01:09.259250 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.250084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36051 (local address 127.22.45.67:33209)
0805 23:01:09.250796 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.250811 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:09.250943 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:09.251287 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:09.251291 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:09.251309 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:09.251651 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.251661 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.252936 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.252945 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.255319 (+ 2374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:09.255333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.257296 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.257321 (+ 25us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:09.257599 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.257690 (+ 91us) client_negotiation.cc:769] Sending connection context
0805 23:01:09.257810 (+ 120us) client_negotiation.cc:240] Negotiation successful
0805 23:01:09.258018 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"mutex_wait_us":268,"thread_start_us":327,"threads_started":1}
I20260805 23:01:09.259450 712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.250171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:56349 (local address 127.22.45.65:33525)
0805 23:01:09.250365 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.250369 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.250615 (+ 246us) server_negotiation.cc:407] Connection header received
0805 23:01:09.250973 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.250980 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.251064 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.251166 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:09.251647 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.252738 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.255506 (+ 2768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.256805 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.257012 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.257091 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.258874 (+ 1783us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.259091 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:01:09.260259 315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c7a6e2e2d14963be871bce495d7ede" candidate_uuid: "363a540217f5466f9606df810a3ba9ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbca29ee5127477a8448fa55c04e180c" is_pre_election: true
I20260805 23:01:09.260354 32584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c7a6e2e2d14963be871bce495d7ede" candidate_uuid: "363a540217f5466f9606df810a3ba9ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fc6712346d34d52ac512258e82813d0" is_pre_election: true
I20260805 23:01:09.260514 315 raft_consensus.cc:2454] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363a540217f5466f9606df810a3ba9ec in term 0.
I20260805 23:01:09.260775 32584 raft_consensus.cc:2454] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363a540217f5466f9606df810a3ba9ec in term 0.
I20260805 23:01:09.261070 425 leader_election.cc:302] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363a540217f5466f9606df810a3ba9ec, cbca29ee5127477a8448fa55c04e180c; no voters:
I20260805 23:01:09.261509 735 raft_consensus.cc:2781] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:09.261663 735 raft_consensus.cc:482] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:09.261819 735 raft_consensus.cc:3037] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:09.264181 735 raft_consensus.cc:504] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.264950 735 leader_election.cc:288] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [CANDIDATE]: Term 1 election: Requested vote from peers 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525), cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051)
I20260805 23:01:09.265528 32584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c7a6e2e2d14963be871bce495d7ede" candidate_uuid: "363a540217f5466f9606df810a3ba9ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fc6712346d34d52ac512258e82813d0"
I20260805 23:01:09.265657 315 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3c7a6e2e2d14963be871bce495d7ede" candidate_uuid: "363a540217f5466f9606df810a3ba9ec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbca29ee5127477a8448fa55c04e180c"
I20260805 23:01:09.265789 32584 raft_consensus.cc:3037] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:09.265883 315 raft_consensus.cc:3037] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:09.269021 32584 raft_consensus.cc:2454] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363a540217f5466f9606df810a3ba9ec in term 1.
I20260805 23:01:09.269021 315 raft_consensus.cc:2454] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363a540217f5466f9606df810a3ba9ec in term 1.
I20260805 23:01:09.269644 424 leader_election.cc:302] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1fc6712346d34d52ac512258e82813d0, 363a540217f5466f9606df810a3ba9ec, cbca29ee5127477a8448fa55c04e180c; no voters:
I20260805 23:01:09.270054 735 raft_consensus.cc:2781] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:09.270627 735 raft_consensus.cc:686] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 1 LEADER]: Becoming Leader. State: Replica: 363a540217f5466f9606df810a3ba9ec, State: Running, Role: LEADER
I20260805 23:01:09.271108 735 consensus_queue.cc:237] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } }
I20260805 23:01:09.271821 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.271359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:46825)
0805 23:01:09.271524 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.271639 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260805 23:01:09.275629 32399 catalog_manager.cc:5495] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec reported cstate change: term changed from 0 to 1, leader changed from <none> to 363a540217f5466f9606df810a3ba9ec (127.22.45.67). New cstate: current_term: 1 leader_uuid: "363a540217f5466f9606df810a3ba9ec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363a540217f5466f9606df810a3ba9ec" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46187 } health_report { overall_health: HEALTHY } } }
I20260805 23:01:09.303838 715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.297010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57306 (local address 127.22.45.67:46187)
0805 23:01:09.297422 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.297428 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.297449 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:01:09.297553 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.297557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.297653 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.297814 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:09.298281 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.299184 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.300792 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.301266 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.301377 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.301903 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:09.302577 (+ 674us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:09.302707 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.303250 (+ 543us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.303391 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141}
I20260805 23:01:09.309028 315 raft_consensus.cc:1261] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Refusing update from remote peer 363a540217f5466f9606df810a3ba9ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:09.309439 32584 raft_consensus.cc:1261] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 1 FOLLOWER]: Refusing update from remote peer 363a540217f5466f9606df810a3ba9ec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:09.310004 735 consensus_queue.cc:1035] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbca29ee5127477a8448fa55c04e180c" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:09.310356 743 consensus_queue.cc:1035] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fc6712346d34d52ac512258e82813d0" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33525 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:09.313587 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.312636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.66:57653)
0805 23:01:09.312968 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.313249 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
I20260805 23:01:09.314183 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.313619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.65:50099)
0805 23:01:09.313812 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.313944 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260805 23:01:09.320055 32655 tablet.cc:2369] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:09.322077 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.321352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.66:50457)
0805 23:01:09.321706 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.321855 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208}
I20260805 23:01:09.322767 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.321341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:40957)
0805 23:01:09.322415 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.322528 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":940}
I20260805 23:01:09.324151 748 mvcc.cc:205] Tried to move back new op lower bound from 7315336680681312256 to 7315336680539553792. Current Snapshot: MvccSnapshot[applied={T|T < 7315336680681312256}]
I20260805 23:01:09.324483 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.323971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.67:49029)
0805 23:01:09.324193 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.324301 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260805 23:01:09.325870 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.325264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.22.45.65:39051)
0805 23:01:09.325557 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.325671 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260805 23:01:09.344269 32401 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:09.344697 32401 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:09.352607 32401 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75b857da4ff940f49befbfeab8e7a904: Sending DeleteTablet for 3 replicas of tablet f3c7a6e2e2d14963be871bce495d7ede
I20260805 23:01:09.354104 32560 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c7a6e2e2d14963be871bce495d7ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:09 UTC) from {username='oryx', principal='oryx/127.22.45.124@KRBTEST.COM'} at 127.0.0.1:53454
I20260805 23:01:09.354549 32758 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c7a6e2e2d14963be871bce495d7ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:09 UTC) from {username='oryx', principal='oryx/127.22.45.124@KRBTEST.COM'} at 127.0.0.1:56158
I20260805 23:01:09.359122 489 tablet_service.cc:1514] Processing DeleteTablet for tablet f3c7a6e2e2d14963be871bce495d7ede with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:09 UTC) from {username='oryx', principal='oryx/127.22.45.124@KRBTEST.COM'} at 127.0.0.1:57292
I20260805 23:01:09.361441 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 32400
I20260805 23:01:09.373119 758 tablet_replica.cc:330] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: stopping tablet replica
I20260805 23:01:09.373389 758 raft_consensus.cc:2229] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:09.373765 758 raft_consensus.cc:2258] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:09.375226 758 ts_tablet_manager.cc:1905] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:09.377854 757 tablet_replica.cc:330] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: stopping tablet replica
I20260805 23:01:09.378307 757 raft_consensus.cc:2229] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:09.378954 757 raft_consensus.cc:2258] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:09.380496 760 tablet_replica.cc:330] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: stopping tablet replica
I20260805 23:01:09.380879 760 raft_consensus.cc:2229] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:01:09.381759 760 raft_consensus.cc:2258] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:09.383198 760 ts_tablet_manager.cc:1905] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:09.385071 758 ts_tablet_manager.cc:1918] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:09.385243 758 log.cc:1196] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/f3c7a6e2e2d14963be871bce495d7ede
I20260805 23:01:09.385749 758 ts_tablet_manager.cc:1939] T f3c7a6e2e2d14963be871bce495d7ede P cbca29ee5127477a8448fa55c04e180c: Deleting consensus metadata
I20260805 23:01:09.387244 32378 catalog_manager.cc:4841] TS cbca29ee5127477a8448fa55c04e180c (127.22.45.66:36051): tablet f3c7a6e2e2d14963be871bce495d7ede (table test-table [id=901d19c84250432a8c1bcb5154be4f66]) successfully deleted
I20260805 23:01:09.388561 757 ts_tablet_manager.cc:1905] T f3c7a6e2e2d14963be871bce495d7ede P 1fc6712346d34d52ac512258e82813d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:09.391399 760 ts_tablet_manager.cc:1918] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:09.391705 760 log.cc:1196] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/f3c7a6e2e2d14963be871bce495d7ede
I20260805 23:01:09.391963 712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.362505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53460 (local address 127.22.45.65:33525)
0805 23:01:09.362733 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.362740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.371173 (+ 8433us) server_negotiation.cc:407] Connection header received
0805 23:01:09.371502 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.371510 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.371636 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.371723 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:09.374000 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.375213 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.377445 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.378213 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.378508 (+ 295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.382859 (+ 4351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:09.382882 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:09.382905 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:09.383094 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:09.387809 (+ 4715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:09.388941 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:09.388953 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:09.388956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:09.389126 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:09.389722 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:09.389727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:09.389731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:09.390293 (+ 562us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:09.390614 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.391297 (+ 683us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.391567 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 23:01:09.392570 760 ts_tablet_manager.cc:1939] T f3c7a6e2e2d14963be871bce495d7ede P 363a540217f5466f9606df810a3ba9ec: Deleting consensus metadata
I20260805 23:01:09.393579 32642 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:09.393915 32376 catalog_manager.cc:4841] TS 363a540217f5466f9606df810a3ba9ec (127.22.45.67:46187): tablet f3c7a6e2e2d14963be871bce495d7ede (table test-table [id=901d19c84250432a8c1bcb5154be4f66]) successfully deleted
I20260805 23:01:09.525980 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 32400
I20260805 23:01:09.556325 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.555800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52480)
0805 23:01:09.556004 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.556130 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260805 23:01:09.558156 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.557182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52490)
0805 23:01:09.557369 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.557467 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260805 23:01:09.561754 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 32666
I20260805 23:01:09.562698 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.562231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53476)
0805 23:01:09.562404 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.562503 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 23:01:09.563191 32376 catalog_manager.cc:4584] TS 1fc6712346d34d52ac512258e82813d0 (127.22.45.65:33525): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f3c7a6e2e2d14963be871bce495d7ede: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
I20260805 23:01:09.579941 713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.563052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56168 (local address 127.22.45.66:36051)
0805 23:01:09.563294 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.563300 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.563329 (+ 29us) server_negotiation.cc:407] Connection header received
0805 23:01:09.563429 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.563435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.563550 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.563723 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:09.565178 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.566405 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.568000 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.568669 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.568815 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.571546 (+ 2731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:09.571568 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:09.571598 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:09.571646 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:09.575787 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:09.576904 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:09.576921 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:09.576925 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:09.577233 (+ 308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:09.577838 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:09.577844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:09.577848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:09.578426 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:09.578773 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.579341 (+ 568us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.579635 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260805 23:01:09.580899 378 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:09.624354 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.623762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53484)
0805 23:01:09.624024 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.624153 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260805 23:01:09.625703 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.625229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53488)
0805 23:01:09.625406 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.625534 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260805 23:01:09.696499 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.695722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53494)
0805 23:01:09.696036 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.696280 (+ 244us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
I20260805 23:01:09.699095 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.698578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53502)
0805 23:01:09.698786 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.698891 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260805 23:01:09.699169 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 32666
I20260805 23:01:09.726758 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 401
I20260805 23:01:09.744952 715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.727940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57308 (local address 127.22.45.67:46187)
0805 23:01:09.728171 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:09.728178 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:09.728205 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:01:09.728276 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:09.728282 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:09.728373 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:09.728493 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:09.729857 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.731094 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.732353 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:09.733005 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:09.733150 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:09.735905 (+ 2755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:09.735924 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:09.735946 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:09.736002 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:09.740798 (+ 4796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:09.741714 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:09.741725 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:09.741729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:09.742022 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:09.742765 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:09.742771 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:09.742774 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:09.743384 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:09.743768 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:09.744103 (+ 335us) server_negotiation.cc:299] Negotiation successful
0805 23:01:09.744387 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:01:09.745819 567 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:09.800818 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.800254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53512)
0805 23:01:09.800513 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.800657 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116}
I20260805 23:01:09.801980 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.801561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53524)
0805 23:01:09.801764 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.801848 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 23:01:09.881940 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 401
I20260805 23:01:09.908119 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 31942
I20260805 23:01:09.909317 32179 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:09.962760 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.962240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52500)
0805 23:01:09.962470 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.962573 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260805 23:01:09.963909 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.963537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39013 (local address 127.0.0.1:52502)
0805 23:01:09.963706 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.963785 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39013: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260805 23:01:09.973290 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.972780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53538)
0805 23:01:09.972988 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.973106 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260805 23:01:09.974349 690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:09.973975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33525 (local address 127.0.0.1:53552)
0805 23:01:09.974128 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:09.974214 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:33525: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260805 23:01:10.029811 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 31942
I20260805 23:01:10.057421 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 32080
I20260805 23:01:10.058629 32439 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:10.184532 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 32080
2026-08-05T23:01:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (10555 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:01:10 dist-test-slave-1vmg krb5kdc[776](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:01:10 dist-test-slave-1vmg krb5kdc[776](info): set up 2 sockets
Aug 05 23:01:10 dist-test-slave-1vmg krb5kdc[776](info): commencing operation
krb5kdc: starting...
W20260805 23:01:11.383733 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.150s user 0.005s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:01:11 dist-test-slave-1vmg krb5kdc[776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:01:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:11Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab.
Entry for principal oryx/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab.
I20260805 23:01:11.658614 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38269
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab
--principal=oryx/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:38269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:12.016024 798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:12.016396 798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:12.016552 798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:12.024276 798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:12.024439 798 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260805 23:01:12.024515 798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:12.024609 798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:12.024688 798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:12.024781 798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:12.035929 798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:38269
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.126.keytab
--principal=oryx/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:12.037501 798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:12.039289 798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:12.053375 807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:12.053282 810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:12.053364 808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:12.054615 798 server_base.cc:1034] running on GCE node
I20260805 23:01:12.055612 798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:12.057471 798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:12.058754 798 hybrid_clock.cc:648] HybridClock initialized: now 1785970872058679 us; error 64 us; skew 500 ppm
I20260805 23:01:12.059264 798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:12 dist-test-slave-1vmg krb5kdc[776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970872, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:12.063117 798 init.cc:377] Logged in from keytab as oryx/127.22.45.126@KRBTEST.COM (short username oryx)
I20260805 23:01:12.065050 798 webserver.cc:460] Webserver started at http://127.22.45.126:36853/ using document root <none> and password file <none>
I20260805 23:01:12.065883 798 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:12.065999 798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:12.066375 798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:12.069900 798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "74dd9f7278fa4dabb59f61737d5ad61b"
format_stamp: "Formatted at 2026-08-05 23:01:12 on dist-test-slave-1vmg"
server_key: "85230578713f67c3a268f92212bd7f66"
server_key_iv: "663452ef96dac1d6eecd106d423d8578"
server_key_version: "encryptionkey@0"
I20260805 23:01:12.070887 798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "74dd9f7278fa4dabb59f61737d5ad61b"
format_stamp: "Formatted at 2026-08-05 23:01:12 on dist-test-slave-1vmg"
server_key: "85230578713f67c3a268f92212bd7f66"
server_key_iv: "663452ef96dac1d6eecd106d423d8578"
server_key_version: "encryptionkey@0"
I20260805 23:01:12.077100 798 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:01:12.081715 819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:12.083439 798 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:01:12.083679 798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "74dd9f7278fa4dabb59f61737d5ad61b"
format_stamp: "Formatted at 2026-08-05 23:01:12 on dist-test-slave-1vmg"
server_key: "85230578713f67c3a268f92212bd7f66"
server_key_iv: "663452ef96dac1d6eecd106d423d8578"
server_key_version: "encryptionkey@0"
I20260805 23:01:12.083932 798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:12.097353 798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:12.102614 798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:12.103013 798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:12.129345 899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:38269 every 8 connection(s)
I20260805 23:01:12.129501 798 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:38269
I20260805 23:01:12.131520 798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:01:12.136268 900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:12.137122 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 798
I20260805 23:01:12.137364 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:01:12.138543 22709 external_mini_cluster.cc:1428] Setting key af092f525b154de98842d3083897554c
I20260805 23:01:12.153172 900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Bootstrap starting.
Aug 05 23:01:12 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:12.157672 900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:12.159163 900 log.cc:824] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:12.163551 900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: No bootstrap required, opened a new log
I20260805 23:01:12.167502 905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:12.141186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42916 (local address 127.22.45.126:38269)
0805 23:01:12.142098 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:12.142115 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:12.142167 (+ 52us) server_negotiation.cc:407] Connection header received
0805 23:01:12.144066 (+ 1899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:12.144104 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:12.144654 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:12.145057 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:12.147120 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.148543 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.150532 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.151455 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.151634 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:12.157163 (+ 5529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:12.157173 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:12.157193 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:12.157257 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:12.162083 (+ 4826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:12.163311 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:12.163319 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:12.163327 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:12.163570 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:12.164078 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:12.164082 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:12.164084 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:12.164754 (+ 670us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:12.165076 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:12.165688 (+ 612us) server_negotiation.cc:299] Negotiation successful
0805 23:01:12.166218 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":405,"threads_started":1}
I20260805 23:01:12.172874 900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38269 } }
I20260805 23:01:12.173334 900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:12.173440 900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74dd9f7278fa4dabb59f61737d5ad61b, State: Initialized, Role: FOLLOWER
I20260805 23:01:12.174067 900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38269 } }
I20260805 23:01:12.174330 900 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:01:12.174466 900 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:01:12.174635 900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:12.177372 900 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38269 } }
I20260805 23:01:12.177994 900 leader_election.cc:302] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74dd9f7278fa4dabb59f61737d5ad61b; no voters:
I20260805 23:01:12.178673 900 leader_election.cc:288] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:01:12.178886 908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:12.180142 908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [term 1 LEADER]: Becoming Leader. State: Replica: 74dd9f7278fa4dabb59f61737d5ad61b, State: Running, Role: LEADER
I20260805 23:01:12.180750 908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38269 } }
I20260805 23:01:12.181348 900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:12.183974 910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38269 } } }
I20260805 23:01:12.183957 911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74dd9f7278fa4dabb59f61737d5ad61b. Latest consensus state: current_term: 1 leader_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74dd9f7278fa4dabb59f61737d5ad61b" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38269 } } }
I20260805 23:01:12.184533 910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:12.184533 911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:12.186679 921 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:12.192221 921 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:12.201830 921 catalog_manager.cc:1347] Generated new cluster ID: acfa9e0242b342a783ea73242e3f92f4
I20260805 23:01:12.201987 921 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:12.217934 921 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:01:12.219463 921 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:12.232288 921 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Generated new TSK 0
I20260805 23:01:12.233323 921 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab.
Entry for principal oryx/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab.
I20260805 23:01:12.295390 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38269
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab
--principal=oryx/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:12.660684 938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:12.661041 938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:12.661199 938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:12.668812 938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:12.668956 938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:12.669090 938 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:01:12.669203 938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:12.679664 938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab
--principal=oryx/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:12.681190 938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:12.682858 938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:12.696988 945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:12.696928 949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:12.696952 947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:12.698063 938 server_base.cc:1034] running on GCE node
I20260805 23:01:12.698762 938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:12.699800 938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:12.701030 938 hybrid_clock.cc:648] HybridClock initialized: now 1785970872700940 us; error 66 us; skew 500 ppm
I20260805 23:01:12.701345 938 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:12 dist-test-slave-1vmg krb5kdc[776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970872, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:12.712342 938 init.cc:377] Logged in from keytab as oryx/127.22.45.65@KRBTEST.COM (short username oryx)
I20260805 23:01:12.714169 938 webserver.cc:460] Webserver started at http://127.22.45.65:41371/ using document root <none> and password file <none>
I20260805 23:01:12.715018 938 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:12.715140 938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:12.715487 938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:12.719074 938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "89a464783be34e309033ddf0b1e0b785"
format_stamp: "Formatted at 2026-08-05 23:01:12 on dist-test-slave-1vmg"
server_key: "750e7bdbb70ec83d3ec94f6e47596142"
server_key_iv: "9d2972c05c793d863c12b13175f26f44"
server_key_version: "encryptionkey@0"
I20260805 23:01:12.720165 938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "89a464783be34e309033ddf0b1e0b785"
format_stamp: "Formatted at 2026-08-05 23:01:12 on dist-test-slave-1vmg"
server_key: "750e7bdbb70ec83d3ec94f6e47596142"
server_key_iv: "9d2972c05c793d863c12b13175f26f44"
server_key_version: "encryptionkey@0"
I20260805 23:01:12.727192 938 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260805 23:01:12.732235 956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:12.734057 938 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260805 23:01:12.734251 938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "89a464783be34e309033ddf0b1e0b785"
format_stamp: "Formatted at 2026-08-05 23:01:12 on dist-test-slave-1vmg"
server_key: "750e7bdbb70ec83d3ec94f6e47596142"
server_key_iv: "9d2972c05c793d863c12b13175f26f44"
server_key_version: "encryptionkey@0"
I20260805 23:01:12.734498 938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:12.757509 938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:12.762416 938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:12.762686 938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:12.765646 938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:12.765744 938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:12.765887 938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:12.765944 938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:01:12 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970872, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:12.793409 969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:12.766419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:41673 (local address 127.22.45.126:38269)
0805 23:01:12.766976 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:12.766983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:12.768395 (+ 1412us) server_negotiation.cc:407] Connection header received
0805 23:01:12.771061 (+ 2666us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:12.771068 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:12.771170 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:12.771296 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:12.774322 (+ 3026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.775410 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.777823 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.778526 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.778720 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:12.785770 (+ 7050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:12.785779 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:12.785785 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:12.785840 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:12.789224 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:12.790381 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:12.790388 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:12.790392 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:12.790582 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:12.791331 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:12.791338 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:12.791342 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:12.791665 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:12.791831 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:12.792739 (+ 908us) server_negotiation.cc:299] Negotiation successful
0805 23:01:12.793032 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"thread_start_us":255,"threads_started":1}
I20260805 23:01:12.794555 970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:12.767104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38269 (local address 127.22.45.65:41673)
0805 23:01:12.768157 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:12.768217 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:12.770593 (+ 2376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:12.771692 (+ 1099us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:12.771712 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:12.772777 (+ 1065us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:12.773986 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:12.774023 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.775610 (+ 1587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.775614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:12.777592 (+ 1978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:12.777621 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.778947 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.778958 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:12.779342 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:12.780434 (+ 1092us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:12.780481 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:12.785314 (+ 4833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:12.789432 (+ 4118us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:12.789444 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:12.789468 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:12.790207 (+ 739us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:12.790758 (+ 551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:12.790768 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:12.790771 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:12.791167 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:12.791824 (+ 657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:12.791833 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:12.792288 (+ 455us) client_negotiation.cc:769] Sending connection context
0805 23:01:12.792570 (+ 282us) client_negotiation.cc:240] Negotiation successful
0805 23:01:12.793209 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":384,"threads_started":1}
I20260805 23:01:12.819917 938 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:34977
I20260805 23:01:12.819978 1121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:34977 every 8 connection(s)
I20260805 23:01:12.821485 938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:12.822600 1096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:12.806006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38269 (local address 127.22.45.65:47821)
0805 23:01:12.807098 (+ 1092us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:12.807125 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:12.807313 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:12.807711 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:12.807715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:12.808231 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:12.808555 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:12.808567 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.809645 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.809649 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:12.810758 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:12.810774 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.811715 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.811727 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:12.811958 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:12.812864 (+ 906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:12.812891 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:12.814133 (+ 1242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:12.819306 (+ 5173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:12.819313 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:12.819317 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:12.820092 (+ 775us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:12.820581 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:12.820586 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:12.820591 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:12.820737 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:12.821341 (+ 604us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:12.821347 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:12.821554 (+ 207us) client_negotiation.cc:769] Sending connection context
0805 23:01:12.821703 (+ 149us) client_negotiation.cc:240] Negotiation successful
0805 23:01:12.822019 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":887,"thread_start_us":671,"threads_started":1}
I20260805 23:01:12.822619 969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:12.805975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:47821 (local address 127.22.45.126:38269)
0805 23:01:12.806239 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:12.806246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:12.807246 (+ 1000us) server_negotiation.cc:407] Connection header received
0805 23:01:12.807453 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:12.807460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:12.807539 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:12.807628 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:12.808728 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.809490 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.810962 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:12.811455 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:12.811605 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:12.814457 (+ 2852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:12.814463 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:12.814466 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:12.814515 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:12.819060 (+ 4545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:12.820271 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:12.820278 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:12.820282 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:12.820446 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:12.820857 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:12.820861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:12.820863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:12.821203 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:12.821365 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:12.821872 (+ 507us) server_negotiation.cc:299] Negotiation successful
0805 23:01:12.822175 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260805 23:01:12.824757 1122 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38269
I20260805 23:01:12.825027 1122 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:12.825776 1122 heartbeater.cc:511] Master 127.22.45.126:38269 requested a full tablet report, sending...
I20260805 23:01:12.827263 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 938
I20260805 23:01:12.827451 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:01:12.828104 22709 external_mini_cluster.cc:1428] Setting key 5f2451f19d24e21714e365446d734b68
I20260805 23:01:12.828161 840 ts_manager.cc:194] Registered new tserver with Master: 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977)
I20260805 23:01:12.830077 840 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:41673
WARNING: no policy specified for oryx/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab.
Entry for principal oryx/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab.
I20260805 23:01:12.886152 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38269
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab
--principal=oryx/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:13.250118 1129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:13.250432 1129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:13.250556 1129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:13.258085 1129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:13.258241 1129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:13.258352 1129 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:01:13.258468 1129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:13.268836 1129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab
--principal=oryx/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:13.270344 1129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:13.271852 1129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:13.286126 1140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:13.286072 1137 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:13.286648 1136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:13.287067 1129 server_base.cc:1034] running on GCE node
I20260805 23:01:13.287822 1129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:13.288856 1129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:13.290153 1129 hybrid_clock.cc:648] HybridClock initialized: now 1785970873290075 us; error 45 us; skew 500 ppm
I20260805 23:01:13.290498 1129 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:13 dist-test-slave-1vmg krb5kdc[776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970873, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:13.294301 1129 init.cc:377] Logged in from keytab as oryx/127.22.45.66@KRBTEST.COM (short username oryx)
I20260805 23:01:13.296046 1129 webserver.cc:460] Webserver started at http://127.22.45.66:37499/ using document root <none> and password file <none>
I20260805 23:01:13.296854 1129 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:13.296972 1129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:13.297320 1129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:13.300693 1129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6"
format_stamp: "Formatted at 2026-08-05 23:01:13 on dist-test-slave-1vmg"
server_key: "761a13e9fc459100e6213745052d55a0"
server_key_iv: "cf9d68e0d3f2cc67f5e7c57f1c931f20"
server_key_version: "encryptionkey@0"
I20260805 23:01:13.301601 1129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6"
format_stamp: "Formatted at 2026-08-05 23:01:13 on dist-test-slave-1vmg"
server_key: "761a13e9fc459100e6213745052d55a0"
server_key_iv: "cf9d68e0d3f2cc67f5e7c57f1c931f20"
server_key_version: "encryptionkey@0"
I20260805 23:01:13.307600 1129 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 23:01:13.311448 1147 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:13.312908 1129 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:01:13.313107 1129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6"
format_stamp: "Formatted at 2026-08-05 23:01:13 on dist-test-slave-1vmg"
server_key: "761a13e9fc459100e6213745052d55a0"
server_key_iv: "cf9d68e0d3f2cc67f5e7c57f1c931f20"
server_key_version: "encryptionkey@0"
I20260805 23:01:13.313359 1129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:13.336846 1129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:13.341354 1129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:13.341645 1129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:13.344591 1129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:13.344692 1129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:13.344839 1129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:13.344897 1129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:01:13 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970873, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:13.370114 1158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.345277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:34463 (local address 127.22.45.126:38269)
0805 23:01:13.345807 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:13.345814 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:13.347151 (+ 1337us) server_negotiation.cc:407] Connection header received
0805 23:01:13.349372 (+ 2221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:13.349379 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:13.349486 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:13.349625 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:13.351636 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.352702 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.355866 (+ 3164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.356623 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.356788 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.361611 (+ 4823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:13.361620 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:13.361626 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:13.361685 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:13.365500 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.366904 (+ 1404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.366909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.366940 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.367115 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.367729 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.367735 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.367739 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.368195 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:13.368493 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:13.369304 (+ 811us) server_negotiation.cc:299] Negotiation successful
0805 23:01:13.369645 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":253,"threads_started":1}
I20260805 23:01:13.371315 1159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.346010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38269 (local address 127.22.45.66:34463)
0805 23:01:13.346960 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:13.347013 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:13.349007 (+ 1994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:13.349925 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:13.349935 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:13.350521 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:13.351345 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.351382 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.353007 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.353013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.355541 (+ 2528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.355567 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.356899 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.356906 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.357139 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.357974 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:13.358026 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:13.361228 (+ 3202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:13.365754 (+ 4526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.365767 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.365789 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.366676 (+ 887us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.367249 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.367255 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.367259 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.367551 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.368430 (+ 879us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:13.368438 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:13.368870 (+ 432us) client_negotiation.cc:769] Sending connection context
0805 23:01:13.369133 (+ 263us) client_negotiation.cc:240] Negotiation successful
0805 23:01:13.369628 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":370,"threads_started":1}
I20260805 23:01:13.393018 1158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.377779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:56711 (local address 127.22.45.126:38269)
0805 23:01:13.377996 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:13.378002 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:13.378636 (+ 634us) server_negotiation.cc:407] Connection header received
0805 23:01:13.378877 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:13.378884 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:13.379015 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:13.379151 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:13.380270 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.381459 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.383678 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.384136 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.384273 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.386364 (+ 2091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:13.386371 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:13.386377 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:13.386414 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:13.389559 (+ 3145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.390618 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.390622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.390625 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.390763 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.391306 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.391311 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.391315 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.391755 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:13.391931 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:13.392506 (+ 575us) server_negotiation.cc:299] Negotiation successful
0805 23:01:13.392768 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 23:01:13.393384 1228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.377652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38269 (local address 127.22.45.66:56711)
0805 23:01:13.378503 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:13.378522 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:13.378721 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:13.379216 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:13.379221 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:13.379776 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:13.380101 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.380112 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.381642 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.381648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.383498 (+ 1850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.383526 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.384364 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.384372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.384562 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.385298 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:13.385317 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:13.386108 (+ 791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:13.389737 (+ 3629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.389744 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.389753 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.390469 (+ 716us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.390882 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.390887 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.390892 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.391108 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.391891 (+ 783us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:13.391896 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:13.392176 (+ 280us) client_negotiation.cc:769] Sending connection context
0805 23:01:13.392393 (+ 217us) client_negotiation.cc:240] Negotiation successful
0805 23:01:13.392857 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":660,"thread_start_us":472,"threads_started":1}
I20260805 23:01:13.404768 1129 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:39631
I20260805 23:01:13.404772 1305 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:39631 every 8 connection(s)
I20260805 23:01:13.406139 1129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:13.408450 1307 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38269
I20260805 23:01:13.408725 1307 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:13.409399 1307 heartbeater.cc:511] Master 127.22.45.126:38269 requested a full tablet report, sending...
I20260805 23:01:13.410797 840 ts_manager.cc:194] Registered new tserver with Master: ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631)
I20260805 23:01:13.411633 840 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:34463
I20260805 23:01:13.415264 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 1129
I20260805 23:01:13.415416 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:01:13.415838 22709 external_mini_cluster.cc:1428] Setting key 5c3039c3d66fbb2acc0b1d6f2f077f8a
WARNING: no policy specified for oryx/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab.
Entry for principal oryx/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab.
I20260805 23:01:13.470100 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:38269
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab
--principal=oryx/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:41077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:01:13.833465 1122 heartbeater.cc:503] Master 127.22.45.126:38269 was elected leader, sending a full tablet report...
W20260805 23:01:13.837721 1313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:13.838050 1313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:13.838189 1313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:13.846732 1313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:13.846892 1313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:13.847039 1313 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260805 23:01:13.847172 1313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:13.857950 1313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:41077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab
--principal=oryx/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.45.126:38269
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:13.859463 1313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:13.860977 1313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:13.875733 1320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:13.875768 1325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:13.875790 1321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:13.877087 1313 server_base.cc:1034] running on GCE node
I20260805 23:01:13.878335 1313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:13.879588 1313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:13.880815 1313 hybrid_clock.cc:648] HybridClock initialized: now 1785970873880752 us; error 50 us; skew 500 ppm
I20260805 23:01:13.881157 1313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:13 dist-test-slave-1vmg krb5kdc[776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970873, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:13.884811 1313 init.cc:377] Logged in from keytab as oryx/127.22.45.67@KRBTEST.COM (short username oryx)
I20260805 23:01:13.886759 1313 webserver.cc:460] Webserver started at http://127.22.45.67:40683/ using document root <none> and password file <none>
I20260805 23:01:13.887701 1313 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:13.887822 1313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:13.888166 1313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:13.891673 1313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "762c586ab75b4fccb05118e0e4da9785"
format_stamp: "Formatted at 2026-08-05 23:01:13 on dist-test-slave-1vmg"
server_key: "336e5a82110913c0e68da47dcaa1c9a0"
server_key_iv: "73135a95f0f7164bf3ba180af66fb20b"
server_key_version: "encryptionkey@0"
I20260805 23:01:13.892627 1313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "762c586ab75b4fccb05118e0e4da9785"
format_stamp: "Formatted at 2026-08-05 23:01:13 on dist-test-slave-1vmg"
server_key: "336e5a82110913c0e68da47dcaa1c9a0"
server_key_iv: "73135a95f0f7164bf3ba180af66fb20b"
server_key_version: "encryptionkey@0"
I20260805 23:01:13.899547 1313 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260805 23:01:13.904153 1338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:13.905921 1313 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:01:13.906148 1313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "762c586ab75b4fccb05118e0e4da9785"
format_stamp: "Formatted at 2026-08-05 23:01:13 on dist-test-slave-1vmg"
server_key: "336e5a82110913c0e68da47dcaa1c9a0"
server_key_iv: "73135a95f0f7164bf3ba180af66fb20b"
server_key_version: "encryptionkey@0"
I20260805 23:01:13.906419 1313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:13.928791 1313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:13.934011 1313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:13.934329 1313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:13.937431 1313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:13.937552 1313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:13.937716 1313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:13.937798 1313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:01:13 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970873, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:13.967315 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.938700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:57789 (local address 127.22.45.126:38269)
0805 23:01:13.939457 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:13.939463 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:13.940966 (+ 1503us) server_negotiation.cc:407] Connection header received
0805 23:01:13.944196 (+ 3230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:13.944204 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:13.944321 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:13.944454 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:13.948504 (+ 4050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.949607 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.952264 (+ 2657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.953009 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.953189 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.959516 (+ 6327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:13.959525 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:13.959531 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:13.959589 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:13.963260 (+ 3671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.964581 (+ 1321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.964589 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.964592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.964770 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.965272 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.965278 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.965282 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.965604 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:13.965765 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:13.966585 (+ 820us) server_negotiation.cc:299] Negotiation successful
0805 23:01:13.966862 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":333,"threads_started":1}
I20260805 23:01:13.969003 1352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.939411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38269 (local address 127.22.45.67:57789)
0805 23:01:13.940689 (+ 1278us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:13.940776 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:13.943616 (+ 2840us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:13.945066 (+ 1450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:13.945092 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:13.946615 (+ 1523us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:13.948092 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.948140 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.949882 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.949887 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.952020 (+ 2133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.952053 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.953327 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.953334 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.953611 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.954583 (+ 972us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:13.954621 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:13.959057 (+ 4436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:13.963463 (+ 4406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.963473 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.963491 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.964391 (+ 900us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.964901 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.964905 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.964908 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.965133 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.965743 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:13.965753 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:13.966159 (+ 406us) client_negotiation.cc:769] Sending connection context
0805 23:01:13.966429 (+ 270us) client_negotiation.cc:240] Negotiation successful
0805 23:01:13.967083 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":583,"threads_started":1}
I20260805 23:01:13.989909 1313 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:45971
I20260805 23:01:13.989919 1509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:45971 every 8 connection(s)
I20260805 23:01:13.991657 1313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:13.994158 1511 heartbeater.cc:347] Connected to a master server at 127.22.45.126:38269
I20260805 23:01:13.994500 1511 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:13.994625 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.977285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38269 (local address 127.22.45.67:50053)
0805 23:01:13.978126 (+ 841us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:13.978152 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:13.978372 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:13.978800 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:13.978805 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:13.979506 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:13.980055 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.980075 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.981724 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.981729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.983013 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:13.983038 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.984249 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.984255 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:13.984382 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.985271 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:13.985300 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:13.986667 (+ 1367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:13.991139 (+ 4472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.991144 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.991147 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.991798 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.992244 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:13.992249 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:13.992252 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:13.992406 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:13.993457 (+ 1051us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:13.993461 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:13.993663 (+ 202us) client_negotiation.cc:769] Sending connection context
0805 23:01:13.993836 (+ 173us) client_negotiation.cc:240] Negotiation successful
0805 23:01:13.994195 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":521,"threads_started":1}
I20260805 23:01:13.994645 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:13.977454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:50053 (local address 127.22.45.126:38269)
0805 23:01:13.977703 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:13.977710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:13.978277 (+ 567us) server_negotiation.cc:407] Connection header received
0805 23:01:13.978551 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:13.978558 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:13.978644 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:13.978737 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:13.980289 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.981538 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.983215 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:13.983978 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:13.984150 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:13.987029 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:13.987037 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:13.987043 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:13.987097 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:13.990896 (+ 3799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.991938 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.991945 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.991949 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.992110 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:13.992575 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:13.992580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:13.992584 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:13.993030 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:13.993252 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:13.994015 (+ 763us) server_negotiation.cc:299] Negotiation successful
0805 23:01:13.994295 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260805 23:01:13.995590 1511 heartbeater.cc:511] Master 127.22.45.126:38269 requested a full tablet report, sending...
I20260805 23:01:13.997228 840 ts_manager.cc:194] Registered new tserver with Master: 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:13.998169 840 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:57789
I20260805 23:01:13.999329 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 1313
I20260805 23:01:13.999516 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:01:14.000345 22709 external_mini_cluster.cc:1428] Setting key 194470a83b2339eacca78e57e08be38a
I20260805 23:01:14.004700 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 05 23:01:14 dist-test-slave-1vmg krb5kdc[776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970874, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 05 23:01:14 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:14 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:14.414180 1307 heartbeater.cc:503] Master 127.22.45.126:38269 was elected leader, sending a full tablet report...
I20260805 23:01:15.001997 1511 heartbeater.cc:503] Master 127.22.45.126:38269 was elected leader, sending a full tablet report...
W20260805 23:01:15.126817 1519 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.065s user 0.007s sys 0.010s
W20260805 23:01:15.128254 1351 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:14.054409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42922 (local address 127.22.45.126:38269)
0805 23:01:14.054661 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:14.054681 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:14.054965 (+ 284us) server_negotiation.cc:407] Connection header received
0805 23:01:14.055191 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:14.055196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:14.055280 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:14.055374 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:14.056865 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:14.057594 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:14.058977 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:14.059689 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:14.059962 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.127911 (+1067949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42922: BlockingRecv error: recv got EOF from 127.0.0.1:42922 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 05 23:01:15 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970874, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:15.148506 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.132263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47314 (local address 127.22.45.126:38269)
0805 23:01:15.132493 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.132501 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.133281 (+ 780us) server_negotiation.cc:407] Connection header received
0805 23:01:15.133527 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.133532 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.133608 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.133721 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:15.135432 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.136210 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.138087 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.138585 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.138695 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.142891 (+ 4196us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:15.142897 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:15.142901 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:15.142981 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:15.145873 (+ 2892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:15.146681 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:15.146685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:15.146688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:15.146841 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:15.147218 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:15.147222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:15.147224 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:15.147516 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:15.147729 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.147977 (+ 248us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.148186 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 23:01:15.153290 840 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:01:15.160624 840 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:15.200075 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.174379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37198 (local address 127.22.45.65:34977)
0805 23:01:15.191387 (+ 17008us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.191396 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.191428 (+ 32us) server_negotiation.cc:407] Connection header received
0805 23:01:15.191530 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.191537 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.191770 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.191998 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:15.192834 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.194366 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.197333 (+ 2967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.198993 (+ 1660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.199149 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.199381 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.199672 (+ 291us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.199826 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16845,"thread_start_us":16678,"threads_started":1}
I20260805 23:01:15.200205 1537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.174050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:34977 (local address 127.0.0.1:37198)
0805 23:01:15.186742 (+ 12692us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:15.186772 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:15.186945 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:15.192061 (+ 5116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:15.192068 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:15.192101 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:15.192610 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.192624 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.194503 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.194512 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.197141 (+ 2629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.197155 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.199207 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.199213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.199407 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.199464 (+ 57us) client_negotiation.cc:769] Sending connection context
0805 23:01:15.199618 (+ 154us) client_negotiation.cc:240] Negotiation successful
0805 23:01:15.199849 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12550,"thread_start_us":10548,"threads_started":1}
I20260805 23:01:15.201545 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.175501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:45971 (local address 127.0.0.1:45948)
0805 23:01:15.191921 (+ 16420us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:15.191952 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:15.192095 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:15.194268 (+ 2173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:15.194273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:15.194298 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:15.194753 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.194767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.196831 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.196837 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.198782 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.198798 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.200706 (+ 1908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.200713 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.200884 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.200920 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:01:15.201018 (+ 98us) client_negotiation.cc:240] Negotiation successful
0805 23:01:15.201170 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16277,"mutex_wait_us":1,"thread_start_us":16685,"threads_started":1}
I20260805 23:01:15.201681 1539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.174047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38442 (local address 127.22.45.66:39631)
0805 23:01:15.192815 (+ 18768us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.192823 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.192851 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:01:15.192952 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.192959 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.193214 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.193958 (+ 744us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:15.194182 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.195461 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.197482 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.198993 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.199149 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.199381 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.201207 (+ 1826us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.201385 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18596,"thread_start_us":19682,"threads_started":1}
I20260805 23:01:15.202147 1540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.173909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:39631 (local address 127.0.0.1:38442)
0805 23:01:15.185105 (+ 11196us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:15.185163 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:15.185402 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:15.193524 (+ 8122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:15.193529 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:15.193554 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:15.193945 (+ 391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.193958 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.195616 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.195620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.197306 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.197320 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.200803 (+ 3483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.200810 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.200966 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.200994 (+ 28us) client_negotiation.cc:769] Sending connection context
0805 23:01:15.201084 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 23:01:15.201828 (+ 744us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10867,"mutex_wait_us":593,"thread_start_us":12524,"threads_started":1}
I20260805 23:01:15.202198 1543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.175831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45948 (local address 127.22.45.67:45971)
0805 23:01:15.193481 (+ 17650us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.193490 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.193517 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:01:15.193615 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.193622 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.193837 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.194249 (+ 412us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:15.194996 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.196629 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.198980 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.200473 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.200627 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.200829 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.201084 (+ 255us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.201264 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17484,"thread_start_us":18160,"threads_started":1}
I20260805 23:01:15.204931 1025 tablet_service.cc:1467] Processing CreateTablet for tablet 433c3193172e40abb9dc500140290019 (DEFAULT_TABLE table=test-table [id=e4388d0aaccd4c15b8b1a5fb7a9ecb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:15.205533 1211 tablet_service.cc:1467] Processing CreateTablet for tablet 433c3193172e40abb9dc500140290019 (DEFAULT_TABLE table=test-table [id=e4388d0aaccd4c15b8b1a5fb7a9ecb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:15.205742 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 433c3193172e40abb9dc500140290019 (DEFAULT_TABLE table=test-table [id=e4388d0aaccd4c15b8b1a5fb7a9ecb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:15.206744 1211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433c3193172e40abb9dc500140290019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.206781 1025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433c3193172e40abb9dc500140290019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.207130 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 433c3193172e40abb9dc500140290019. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.221897 1544 tablet_bootstrap.cc:492] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Bootstrap starting.
I20260805 23:01:15.225014 1544 tablet_bootstrap.cc:654] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.226017 1547 tablet_bootstrap.cc:492] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Bootstrap starting.
I20260805 23:01:15.226541 1544 log.cc:824] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:15.226895 1545 tablet_bootstrap.cc:492] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Bootstrap starting.
I20260805 23:01:15.230715 1547 tablet_bootstrap.cc:654] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.230724 1545 tablet_bootstrap.cc:654] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.231946 1547 log.cc:824] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:15.232024 1544 tablet_bootstrap.cc:492] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: No bootstrap required, opened a new log
I20260805 23:01:15.232095 1545 log.cc:824] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:15.232337 1544 ts_tablet_manager.cc:1397] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260805 23:01:15.234998 1545 tablet_bootstrap.cc:492] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: No bootstrap required, opened a new log
I20260805 23:01:15.235265 1547 tablet_bootstrap.cc:492] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: No bootstrap required, opened a new log
I20260805 23:01:15.235280 1545 ts_tablet_manager.cc:1397] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260805 23:01:15.235553 1547 ts_tablet_manager.cc:1397] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260805 23:01:15.243398 1545 raft_consensus.cc:348] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.243419 1544 raft_consensus.cc:348] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.243856 1545 raft_consensus.cc:374] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.243887 1544 raft_consensus.cc:374] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.243978 1545 raft_consensus.cc:729] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762c586ab75b4fccb05118e0e4da9785, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.244025 1544 raft_consensus.cc:729] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad84f6fe90f4447ea1fcf1ada7054fe6, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.244685 1545 consensus_queue.cc:260] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.244848 1544 consensus_queue.cc:260] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.246529 1547 raft_consensus.cc:348] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.246903 1545 ts_tablet_manager.cc:1428] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Time spent starting tablet: real 0.012s user 0.009s sys 0.001s
I20260805 23:01:15.247174 1547 raft_consensus.cc:374] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.247294 1547 raft_consensus.cc:729] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.248148 1547 consensus_queue.cc:260] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.250201 1547 ts_tablet_manager.cc:1428] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260805 23:01:15.253062 1544 ts_tablet_manager.cc:1428] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent starting tablet: real 0.020s user 0.011s sys 0.007s
W20260805 23:01:15.327402 1123 tablet.cc:2369] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:15.402482 1553 raft_consensus.cc:482] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:15.402840 1553 raft_consensus.cc:504] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.404728 1553 leader_election.cc:288] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
W20260805 23:01:15.409566 1308 tablet.cc:2369] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:15.413461 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.405706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:49251 (local address 127.22.45.65:34977)
0805 23:01:15.405902 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.405909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.406278 (+ 369us) server_negotiation.cc:407] Connection header received
0805 23:01:15.406670 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.406674 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.406760 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.406856 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:15.407440 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.408277 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.411202 (+ 2925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.412430 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.412618 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.412699 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.413068 (+ 369us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.413215 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:01:15.413547 1543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.405189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:39075 (local address 127.22.45.67:45971)
0805 23:01:15.405426 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.405432 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.406772 (+ 1340us) server_negotiation.cc:407] Connection header received
0805 23:01:15.407045 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.407051 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.407140 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.407200 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:15.408015 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.408815 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.411145 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.412440 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.412618 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.412699 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.413184 (+ 485us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.413316 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260805 23:01:15.413581 1558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.405290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:34977 (local address 127.22.45.66:49251)
0805 23:01:15.406123 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:15.406149 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:15.406437 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:15.406874 (+ 437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:15.406882 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:15.406910 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:15.407292 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.407302 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.408409 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.408415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.410966 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.410982 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.412688 (+ 1706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.412695 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.412873 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.412911 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 23:01:15.413021 (+ 110us) client_negotiation.cc:240] Negotiation successful
0805 23:01:15.413176 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"mutex_wait_us":32,"thread_start_us":617,"threads_started":1}
I20260805 23:01:15.414310 1559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.405380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:45971 (local address 127.22.45.66:39075)
0805 23:01:15.406639 (+ 1259us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:15.406663 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:15.406811 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:15.407410 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:15.407415 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:15.407442 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:15.407830 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.407841 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.408958 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.408962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.410971 (+ 2009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.410987 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.412863 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.412868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.412988 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.413020 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 23:01:15.413788 (+ 768us) client_negotiation.cc:240] Negotiation successful
0805 23:01:15.413933 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1103,"mutex_wait_us":99,"thread_start_us":905,"threads_started":1}
I20260805 23:01:15.414708 1056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433c3193172e40abb9dc500140290019" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a464783be34e309033ddf0b1e0b785" is_pre_election: true
I20260805 23:01:15.415339 1056 raft_consensus.cc:2454] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 0.
I20260805 23:01:15.415297 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433c3193172e40abb9dc500140290019" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785" is_pre_election: true
I20260805 23:01:15.415778 1437 raft_consensus.cc:2454] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 0.
I20260805 23:01:15.416078 1149 leader_election.cc:302] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:15.416536 1553 raft_consensus.cc:2781] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:15.416671 1553 raft_consensus.cc:482] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:15.416771 1553 raft_consensus.cc:3037] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:15.419179 1553 raft_consensus.cc:504] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.419857 1553 leader_election.cc:288] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 election: Requested vote from peers 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:15.420399 1056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433c3193172e40abb9dc500140290019" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a464783be34e309033ddf0b1e0b785"
I20260805 23:01:15.420439 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "433c3193172e40abb9dc500140290019" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785"
I20260805 23:01:15.420652 1437 raft_consensus.cc:3037] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:15.420652 1056 raft_consensus.cc:3037] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:15.424098 1437 raft_consensus.cc:2454] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 1.
I20260805 23:01:15.424098 1056 raft_consensus.cc:2454] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 1.
I20260805 23:01:15.424723 1149 leader_election.cc:302] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:15.425099 1553 raft_consensus.cc:2781] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:15.425626 1553 raft_consensus.cc:686] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 LEADER]: Becoming Leader. State: Replica: ad84f6fe90f4447ea1fcf1ada7054fe6, State: Running, Role: LEADER
I20260805 23:01:15.426229 1553 consensus_queue.cc:237] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.431460 841 catalog_manager.cc:5495] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } health_report { overall_health: UNKNOWN } } }
W20260805 23:01:15.495116 1512 tablet.cc:2369] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:15.503399 1539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.497735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38444 (local address 127.22.45.66:39631)
0805 23:01:15.497967 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.497973 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.497999 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:01:15.498253 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.498258 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.498361 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.498506 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:15.499008 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.499765 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.501195 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.501610 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.501717 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.502206 (+ 489us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:15.502821 (+ 615us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:15.502985 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.503088 (+ 103us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.503169 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 23:01:15.513029 1056 raft_consensus.cc:1261] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Refusing update from remote peer ad84f6fe90f4447ea1fcf1ada7054fe6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:15.513047 1437 raft_consensus.cc:1261] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Refusing update from remote peer ad84f6fe90f4447ea1fcf1ada7054fe6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:15.514276 1560 consensus_queue.cc:1035] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:15.514736 1553 consensus_queue.cc:1035] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:15.528780 1563 mvcc.cc:205] Tried to move back new op lower bound from 7315336706089660416 to 7315336705750269952. Current Snapshot: MvccSnapshot[applied={T|T < 7315336706089660416}]
I20260805 23:01:15.530115 1564 mvcc.cc:205] Tried to move back new op lower bound from 7315336706089660416 to 7315336705750269952. Current Snapshot: MvccSnapshot[applied={T|T < 7315336706089660416}]
I20260805 23:01:15.549228 840 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:15.549563 840 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:15.553998 840 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Sending DeleteTablet for 3 replicas of tablet 433c3193172e40abb9dc500140290019
I20260805 23:01:15.555512 1025 tablet_service.cc:1514] Processing DeleteTablet for tablet 433c3193172e40abb9dc500140290019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:15 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:37198
I20260805 23:01:15.555549 1211 tablet_service.cc:1514] Processing DeleteTablet for tablet 433c3193172e40abb9dc500140290019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:15 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:38442
I20260805 23:01:15.555871 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 433c3193172e40abb9dc500140290019 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:15 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:45948
I20260805 23:01:15.557612 840 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47314:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:01:15.558566 840 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:15.568598 1411 tablet_service.cc:1467] Processing CreateTablet for tablet f403dbfd4d7b4df89301c78cf500ed92 (DEFAULT_TABLE table=test-table [id=5e5ce5475b334e9e9836c90fa07ed9d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:15.568780 1210 tablet_service.cc:1467] Processing CreateTablet for tablet f403dbfd4d7b4df89301c78cf500ed92 (DEFAULT_TABLE table=test-table [id=5e5ce5475b334e9e9836c90fa07ed9d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:15.569393 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f403dbfd4d7b4df89301c78cf500ed92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.569408 1210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f403dbfd4d7b4df89301c78cf500ed92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.572355 1024 tablet_service.cc:1467] Processing CreateTablet for tablet f403dbfd4d7b4df89301c78cf500ed92 (DEFAULT_TABLE table=test-table [id=5e5ce5475b334e9e9836c90fa07ed9d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:15.572955 1577 tablet_replica.cc:330] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: stopping tablet replica
I20260805 23:01:15.572997 1024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f403dbfd4d7b4df89301c78cf500ed92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.573705 1577 raft_consensus.cc:2229] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:15.574702 1577 raft_consensus.cc:2258] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:15.575542 1576 tablet_replica.cc:330] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: stopping tablet replica
I20260805 23:01:15.580139 1576 raft_consensus.cc:2229] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:01:15.581266 1544 tablet_bootstrap.cc:492] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: Bootstrap starting.
I20260805 23:01:15.583484 1547 tablet_bootstrap.cc:492] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: Bootstrap starting.
I20260805 23:01:15.585320 1547 tablet_bootstrap.cc:654] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.585320 1544 tablet_bootstrap.cc:654] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.588739 1575 tablet_replica.cc:330] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: stopping tablet replica
I20260805 23:01:15.589612 1575 raft_consensus.cc:2229] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:15.590165 1576 raft_consensus.cc:2258] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:15.590257 1575 raft_consensus.cc:2258] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:15.591246 1577 ts_tablet_manager.cc:1905] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:15.596095 1576 ts_tablet_manager.cc:1905] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:15.598294 1575 ts_tablet_manager.cc:1905] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:15.599300 1545 tablet_bootstrap.cc:492] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: Bootstrap starting.
I20260805 23:01:15.600980 1544 tablet_bootstrap.cc:492] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: No bootstrap required, opened a new log
I20260805 23:01:15.601158 1545 tablet_bootstrap.cc:654] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.601176 1544 ts_tablet_manager.cc:1397] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.004s
I20260805 23:01:15.602103 1544 raft_consensus.cc:348] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.602551 1544 raft_consensus.cc:374] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.602736 1544 raft_consensus.cc:729] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad84f6fe90f4447ea1fcf1ada7054fe6, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.603014 1577 ts_tablet_manager.cc:1918] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:15.603312 1577 log.cc:1196] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/433c3193172e40abb9dc500140290019
I20260805 23:01:15.603199 1544 consensus_queue.cc:260] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.603878 1544 ts_tablet_manager.cc:1428] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260805 23:01:15.604110 1577 ts_tablet_manager.cc:1939] T 433c3193172e40abb9dc500140290019 P 762c586ab75b4fccb05118e0e4da9785: Deleting consensus metadata
I20260805 23:01:15.606412 823 catalog_manager.cc:4841] TS 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971): tablet 433c3193172e40abb9dc500140290019 (table test-table [id=e4388d0aaccd4c15b8b1a5fb7a9ecb76]) successfully deleted
I20260805 23:01:15.613018 1545 tablet_bootstrap.cc:492] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: No bootstrap required, opened a new log
I20260805 23:01:15.613358 1545 ts_tablet_manager.cc:1397] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.007s
I20260805 23:01:15.613960 1547 tablet_bootstrap.cc:492] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: No bootstrap required, opened a new log
I20260805 23:01:15.614154 1547 ts_tablet_manager.cc:1397] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.008s
I20260805 23:01:15.615175 1547 raft_consensus.cc:348] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.616099 1545 raft_consensus.cc:348] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.616402 1545 raft_consensus.cc:374] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.616562 1545 raft_consensus.cc:729] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762c586ab75b4fccb05118e0e4da9785, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.616745 1547 raft_consensus.cc:374] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.616873 1547 raft_consensus.cc:729] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.617103 1545 consensus_queue.cc:260] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.619002 1547 consensus_queue.cc:260] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.620357 1576 ts_tablet_manager.cc:1918] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:15.621263 1575 ts_tablet_manager.cc:1918] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:15.621511 1575 log.cc:1196] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/433c3193172e40abb9dc500140290019
I20260805 23:01:15.621930 1547 ts_tablet_manager.cc:1428] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: Time spent starting tablet: real 0.008s user 0.003s sys 0.000s
I20260805 23:01:15.622220 1575 ts_tablet_manager.cc:1939] T 433c3193172e40abb9dc500140290019 P 89a464783be34e309033ddf0b1e0b785: Deleting consensus metadata
I20260805 23:01:15.622421 1576 log.cc:1196] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/433c3193172e40abb9dc500140290019
I20260805 23:01:15.623211 1576 ts_tablet_manager.cc:1939] T 433c3193172e40abb9dc500140290019 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting consensus metadata
I20260805 23:01:15.624547 822 catalog_manager.cc:4841] TS 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977): tablet 433c3193172e40abb9dc500140290019 (table test-table [id=e4388d0aaccd4c15b8b1a5fb7a9ecb76]) successfully deleted
I20260805 23:01:15.624945 1545 ts_tablet_manager.cc:1428] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s
I20260805 23:01:15.625139 824 catalog_manager.cc:4841] TS ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631): tablet 433c3193172e40abb9dc500140290019 (table test-table [id=e4388d0aaccd4c15b8b1a5fb7a9ecb76]) successfully deleted
I20260805 23:01:15.673197 1553 raft_consensus.cc:482] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:15.673478 1553 raft_consensus.cc:504] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.674398 1553 leader_election.cc:288] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:15.675330 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f403dbfd4d7b4df89301c78cf500ed92" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785" is_pre_election: true
I20260805 23:01:15.675514 1056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f403dbfd4d7b4df89301c78cf500ed92" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a464783be34e309033ddf0b1e0b785" is_pre_election: true
I20260805 23:01:15.675843 1056 raft_consensus.cc:2454] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 0.
I20260805 23:01:15.675848 1437 raft_consensus.cc:2454] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 0.
I20260805 23:01:15.676461 1150 leader_election.cc:302] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762c586ab75b4fccb05118e0e4da9785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:15.676832 1553 raft_consensus.cc:2781] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:15.676990 1553 raft_consensus.cc:482] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:15.677098 1553 raft_consensus.cc:3037] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:15.680701 1553 raft_consensus.cc:504] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.681600 1553 leader_election.cc:288] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 election: Requested vote from peers 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:15.682360 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f403dbfd4d7b4df89301c78cf500ed92" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785"
I20260805 23:01:15.682403 1056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f403dbfd4d7b4df89301c78cf500ed92" candidate_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a464783be34e309033ddf0b1e0b785"
I20260805 23:01:15.682636 1437 raft_consensus.cc:3037] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:15.682644 1056 raft_consensus.cc:3037] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:15.685678 1437 raft_consensus.cc:2454] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 1.
I20260805 23:01:15.685907 1056 raft_consensus.cc:2454] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad84f6fe90f4447ea1fcf1ada7054fe6 in term 1.
I20260805 23:01:15.686326 1150 leader_election.cc:302] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762c586ab75b4fccb05118e0e4da9785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:15.686720 1553 raft_consensus.cc:2781] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:15.686991 1553 raft_consensus.cc:686] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 LEADER]: Becoming Leader. State: Replica: ad84f6fe90f4447ea1fcf1ada7054fe6, State: Running, Role: LEADER
I20260805 23:01:15.687312 1553 consensus_queue.cc:237] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.690665 840 catalog_manager.cc:5495] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } health_report { overall_health: UNKNOWN } } }
Aug 05 23:01:15 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970872, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.126@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:15.751652 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.730099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38269 (local address 127.0.0.1:47316)
0805 23:01:15.731083 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:15.731105 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:15.731276 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:15.731863 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:15.731868 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:15.732903 (+ 1035us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:15.733313 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.733328 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.735505 (+ 2177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.735511 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.736587 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:15.736604 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.737900 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.737921 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:15.738150 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.739435 (+ 1285us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:15.739473 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:15.743199 (+ 3726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:15.748138 (+ 4939us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:15.748158 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:15.748166 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:15.748731 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:15.749187 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:15.749191 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:15.749194 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:15.749363 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:15.750195 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:15.750206 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:15.750521 (+ 315us) client_negotiation.cc:769] Sending connection context
0805 23:01:15.750765 (+ 244us) client_negotiation.cc:240] Negotiation successful
0805 23:01:15.751243 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":645,"threads_started":1}
I20260805 23:01:15.752079 1593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:15.730099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47316 (local address 127.22.45.126:38269)
0805 23:01:15.730871 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:15.730878 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:15.731212 (+ 334us) server_negotiation.cc:407] Connection header received
0805 23:01:15.731395 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:15.731401 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:15.731501 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:15.731654 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:15.733546 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.735113 (+ 1567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.736876 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:15.737575 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:15.737745 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:15.743492 (+ 5747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:15.743499 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:15.743505 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:15.743555 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:15.747894 (+ 4339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:15.748883 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:15.748889 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:15.748893 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:15.749062 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:15.749475 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:15.749480 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:15.749484 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:15.749910 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:15.750249 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:15.751059 (+ 810us) server_negotiation.cc:299] Negotiation successful
0805 23:01:15.751495 (+ 436us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":587,"thread_start_us":379,"threads_started":1}
I20260805 23:01:15.759379 840 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:47316:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260805 23:01:15.760629 840 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:15.769508 1024 tablet_service.cc:1467] Processing CreateTablet for tablet 74cc3f4a0e2d469fa6d9506141115f7a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=efd2d68620ea4479ad6e4efeee023578]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:01:15.770218 1024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74cc3f4a0e2d469fa6d9506141115f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.775883 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 74cc3f4a0e2d469fa6d9506141115f7a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=efd2d68620ea4479ad6e4efeee023578]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:01:15.776602 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74cc3f4a0e2d469fa6d9506141115f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.777887 1547 tablet_bootstrap.cc:492] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: Bootstrap starting.
I20260805 23:01:15.778638 1210 tablet_service.cc:1467] Processing CreateTablet for tablet 74cc3f4a0e2d469fa6d9506141115f7a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=efd2d68620ea4479ad6e4efeee023578]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260805 23:01:15.779348 1210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74cc3f4a0e2d469fa6d9506141115f7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:15.780130 1547 tablet_bootstrap.cc:654] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.785953 1545 tablet_bootstrap.cc:492] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: Bootstrap starting.
I20260805 23:01:15.787860 1545 tablet_bootstrap.cc:654] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.789285 1544 tablet_bootstrap.cc:492] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: Bootstrap starting.
I20260805 23:01:15.791446 1544 tablet_bootstrap.cc:654] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:15.800439 1545 tablet_bootstrap.cc:492] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: No bootstrap required, opened a new log
I20260805 23:01:15.800771 1545 ts_tablet_manager.cc:1397] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.007s
I20260805 23:01:15.801261 1547 tablet_bootstrap.cc:492] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: No bootstrap required, opened a new log
I20260805 23:01:15.801491 1547 ts_tablet_manager.cc:1397] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: Time spent bootstrapping tablet: real 0.024s user 0.017s sys 0.000s
I20260805 23:01:15.801782 1545 raft_consensus.cc:348] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.802214 1545 raft_consensus.cc:374] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.802354 1545 raft_consensus.cc:729] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762c586ab75b4fccb05118e0e4da9785, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.802358 1547 raft_consensus.cc:348] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.802623 1547 raft_consensus.cc:374] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.802735 1547 raft_consensus.cc:729] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.802806 1545 consensus_queue.cc:260] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.803225 1544 tablet_bootstrap.cc:492] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: No bootstrap required, opened a new log
I20260805 23:01:15.803148 1547 consensus_queue.cc:260] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.803426 1552 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:15.803685 1544 ts_tablet_manager.cc:1397] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.009s
I20260805 23:01:15.803797 1552 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:01:15.803838 1547 ts_tablet_manager.cc:1428] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 23:01:15.804926 1544 raft_consensus.cc:348] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.804932 1556 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:15.805253 1544 raft_consensus.cc:374] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:15.805313 1556 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:01:15.805341 1544 raft_consensus.cc:729] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad84f6fe90f4447ea1fcf1ada7054fe6, State: Initialized, Role: FOLLOWER
I20260805 23:01:15.805601 1544 consensus_queue.cc:260] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:15.806090 1553 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:15.806429 1553 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:01:15.807375 1545 ts_tablet_manager.cc:1428] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260805 23:01:15.807724 1544 ts_tablet_manager.cc:1428] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260805 23:01:16.002995 1556 raft_consensus.cc:482] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:16.003285 1556 raft_consensus.cc:504] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.005193 1556 leader_election.cc:288] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:16.015697 1552 raft_consensus.cc:482] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:16.015957 1552 raft_consensus.cc:504] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.018150 1552 leader_election.cc:288] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977), ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631)
I20260805 23:01:16.030244 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.005454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:39631 (local address 127.22.45.65:51361)
0805 23:01:16.021059 (+ 15605us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.021086 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.021285 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.022692 (+ 1407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.022698 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.022734 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:16.023107 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.023121 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.025064 (+ 1943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.025071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.027307 (+ 2236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.027331 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.029336 (+ 2005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.029342 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.029544 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.029580 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.029669 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.029832 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15446,"threads_started":1}
I20260805 23:01:16.031390 1599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.005987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:51361 (local address 127.22.45.66:39631)
0805 23:01:16.015344 (+ 9357us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.015351 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.021440 (+ 6089us) server_negotiation.cc:407] Connection header received
0805 23:01:16.021548 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.021554 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.021649 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.021750 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:16.023385 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.024806 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.027556 (+ 2750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.028913 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.029074 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.029162 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.030517 (+ 1355us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.030988 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9189,"thread_start_us":9041,"threads_started":1}
I20260805 23:01:16.036914 1245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74cc3f4a0e2d469fa6d9506141115f7a" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" is_pre_election: true
I20260805 23:01:16.037348 1245 raft_consensus.cc:2454] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 0.
I20260805 23:01:16.038589 963 leader_election.cc:302] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:16.039507 1556 raft_consensus.cc:2781] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:16.039634 1556 raft_consensus.cc:482] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:16.039757 1556 raft_consensus.cc:3037] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.042004 1600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.006154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:42959 (local address 127.22.45.67:45971)
0805 23:01:16.022364 (+ 16210us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.022371 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.032061 (+ 9690us) server_negotiation.cc:407] Connection header received
0805 23:01:16.032355 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.032361 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.032444 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.032517 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:16.033259 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.034469 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.037587 (+ 3118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.038968 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.039128 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.039213 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.041508 (+ 2295us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.041652 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":16068,"thread_start_us":17291,"threads_started":1}
I20260805 23:01:16.042625 1598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.005718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:45971 (local address 127.22.45.65:42959)
0805 23:01:16.031939 (+ 26221us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.031963 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.032192 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.032831 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.032836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.032868 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:16.033086 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.033097 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.034662 (+ 1565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.034667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.037393 (+ 2726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.037408 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.039375 (+ 1967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.039382 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.039580 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.039615 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.042186 (+ 2571us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.042337 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26113,"thread_start_us":16658,"threads_started":1}
I20260805 23:01:16.043247 1556 raft_consensus.cc:504] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.043387 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74cc3f4a0e2d469fa6d9506141115f7a" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785" is_pre_election: true
I20260805 23:01:16.043648 1609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.030148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:39631 (local address 127.22.45.67:41571)
0805 23:01:16.036076 (+ 5928us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.036096 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.036247 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.036650 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.036655 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.036681 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:16.037020 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.037032 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.038995 (+ 1963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.039000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.041057 (+ 2057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.041072 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.042845 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.042850 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.043042 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.043075 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.043160 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.043308 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5799,"thread_start_us":5627,"threads_started":1}
I20260805 23:01:16.043670 1437 raft_consensus.cc:2454] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 0.
I20260805 23:01:16.044194 1556 leader_election.cc:288] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 election: Requested vote from peers ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:16.044533 1599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.023993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:41571 (local address 127.22.45.66:39631)
0805 23:01:16.031732 (+ 7739us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.031738 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.036180 (+ 4442us) server_negotiation.cc:407] Connection header received
0805 23:01:16.036368 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.036373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.036446 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.036535 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:16.037181 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.038778 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.041250 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.042437 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.042576 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.042646 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.043835 (+ 1189us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.044173 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7627,"threads_started":1}
I20260805 23:01:16.044865 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74cc3f4a0e2d469fa6d9506141115f7a" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785"
I20260805 23:01:16.045080 1437 raft_consensus.cc:3037] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.046833 1603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.018480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:34977 (local address 127.22.45.67:48303)
0805 23:01:16.033870 (+ 15390us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.033891 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.034025 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.034858 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.034863 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.034901 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:16.035300 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.035313 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.037731 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.037736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.041324 (+ 3588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.041339 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.045964 (+ 4625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.045971 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.046162 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.046208 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.046283 (+ 75us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.046426 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15252,"mutex_wait_us":1414,"thread_start_us":15605,"threads_started":1}
I20260805 23:01:16.047646 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.019083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:48303 (local address 127.22.45.65:34977)
0805 23:01:16.023421 (+ 4338us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.023427 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.034307 (+ 10880us) server_negotiation.cc:407] Connection header received
0805 23:01:16.034371 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.034376 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.034448 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.034556 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:16.035477 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.037553 (+ 2076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.044404 (+ 6851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.045583 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.045735 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.045806 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.047188 (+ 1382us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.047337 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4189,"thread_start_us":3980,"threads_started":1}
I20260805 23:01:16.048208 1056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74cc3f4a0e2d469fa6d9506141115f7a" candidate_uuid: "762c586ab75b4fccb05118e0e4da9785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89a464783be34e309033ddf0b1e0b785" is_pre_election: true
I20260805 23:01:16.048545 1056 raft_consensus.cc:2379] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 762c586ab75b4fccb05118e0e4da9785 in current term 1: Already voted for candidate 89a464783be34e309033ddf0b1e0b785 in this term.
I20260805 23:01:16.048990 1245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74cc3f4a0e2d469fa6d9506141115f7a" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6"
I20260805 23:01:16.049230 1245 raft_consensus.cc:3037] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.049582 1244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74cc3f4a0e2d469fa6d9506141115f7a" candidate_uuid: "762c586ab75b4fccb05118e0e4da9785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" is_pre_election: true
I20260805 23:01:16.050505 1345 leader_election.cc:302] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 762c586ab75b4fccb05118e0e4da9785; no voters: 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6
I20260805 23:01:16.051993 1437 raft_consensus.cc:2454] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 1.
I20260805 23:01:16.052234 1552 raft_consensus.cc:2726] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260805 23:01:16.052481 1245 raft_consensus.cc:2454] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 1.
I20260805 23:01:16.053020 963 leader_election.cc:302] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:16.053380 1556 raft_consensus.cc:2781] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:16.053875 1556 raft_consensus.cc:686] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [term 1 LEADER]: Becoming Leader. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Running, Role: LEADER
I20260805 23:01:16.054522 1556 consensus_queue.cc:237] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.056596 1610 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: TxnStatusTablet state changed. Reason: New leader 89a464783be34e309033ddf0b1e0b785. Latest consensus state: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:16.057099 1610 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:01:16.057899 1613 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260805 23:01:16.058154 1613 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260805 23:01:16.058736 840 catalog_manager.cc:5495] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89a464783be34e309033ddf0b1e0b785 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } health_report { overall_health: UNKNOWN } } }
I20260805 23:01:16.088531 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.081977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37208 (local address 127.22.45.65:34977)
0805 23:01:16.082199 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.082205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.082381 (+ 176us) server_negotiation.cc:407] Connection header received
0805 23:01:16.082810 (+ 429us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.082815 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.082959 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.083114 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:16.083516 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.084363 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.085730 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.086221 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.086341 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.087070 (+ 729us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.087817 (+ 747us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.087962 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.088077 (+ 115us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.088177 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 23:01:16.088640 1592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.082013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:34977 (local address 127.0.0.1:37208)
0805 23:01:16.082286 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.082303 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.082466 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.083150 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.083155 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.083168 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:01:16.083367 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.083376 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.084499 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.084505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.085549 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.085561 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.086390 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.086396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.086619 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.086718 (+ 99us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.087935 (+ 1217us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.087965 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.088053 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.088276 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260805 23:01:16.093945 1437 raft_consensus.cc:1261] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Refusing update from remote peer 89a464783be34e309033ddf0b1e0b785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.094223 1245 raft_consensus.cc:1261] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Refusing update from remote peer 89a464783be34e309033ddf0b1e0b785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.094796 1610 consensus_queue.cc:1035] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.095270 1556 consensus_queue.cc:1035] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.100662 1552 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: TxnStatusTablet state changed. Reason: New leader 89a464783be34e309033ddf0b1e0b785. Latest consensus state: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:16.101027 1552 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:01:16.102896 1553 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: TxnStatusTablet state changed. Reason: New leader 89a464783be34e309033ddf0b1e0b785. Latest consensus state: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:16.103344 1553 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:01:16.112112 1552 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:16.112418 1552 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P 762c586ab75b4fccb05118e0e4da9785: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:01:16.113317 1553 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:16.113660 1553 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P ad84f6fe90f4447ea1fcf1ada7054fe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260805 23:01:16.115311 1616 mvcc.cc:205] Tried to move back new op lower bound from 7315336708472717312 to 7315336708323237888. Current Snapshot: MvccSnapshot[applied={T|T < 7315336708472717312}]
I20260805 23:01:16.120234 1556 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:16.120600 1556 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:01:16.120882 1610 tablet_replica.cc:439] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } } }
I20260805 23:01:16.121199 1610 tablet_replica.cc:442] T 74cc3f4a0e2d469fa6d9506141115f7a P 89a464783be34e309033ddf0b1e0b785: This TxnStatusTablet replica's current role is: LEADER
I20260805 23:01:16.142333 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.136290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:36677 (local address 127.22.45.65:34977)
0805 23:01:16.136523 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.136530 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.137112 (+ 582us) server_negotiation.cc:407] Connection header received
0805 23:01:16.137320 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.137326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.137400 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.137477 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:16.138020 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.138944 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.140551 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.141006 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.141128 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.141583 (+ 455us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.141705 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.141782 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.141924 (+ 142us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.142013 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260805 23:01:16.142416 1630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.136088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:34977 (local address 127.22.45.66:36677)
0805 23:01:16.136993 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.137011 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.137176 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.137511 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.137515 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.137542 (+ 27us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:01:16.137848 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.137859 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.139100 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.139106 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.140401 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.140415 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.141201 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.141207 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.141331 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.141399 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.141802 (+ 403us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.141814 (+ 12us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.141886 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.142035 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"thread_start_us":579,"threads_started":1}
I20260805 23:01:16.152706 1437 raft_consensus.cc:1261] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Refusing update from remote peer ad84f6fe90f4447ea1fcf1ada7054fe6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.152778 1056 raft_consensus.cc:1261] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Refusing update from remote peer ad84f6fe90f4447ea1fcf1ada7054fe6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.153301 1553 consensus_queue.cc:1035] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.153632 1572 consensus_queue.cc:1035] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.197643 1599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.190526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:50623 (local address 127.22.45.66:39631)
0805 23:01:16.190733 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.190740 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.191438 (+ 698us) server_negotiation.cc:407] Connection header received
0805 23:01:16.191611 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.191618 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.191722 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.191822 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:16.192673 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.193605 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.195334 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.195921 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.196072 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.196786 (+ 714us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.196957 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.197072 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.197231 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.197331 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:01:16.197810 1637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.190524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:39631 (local address 127.22.45.65:50623)
0805 23:01:16.191341 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.191359 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.191488 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.191991 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.191996 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.192010 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:01:16.192428 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.192441 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.193742 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.193748 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.195165 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.195182 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.196205 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.196213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.196407 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.196542 (+ 135us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.197080 (+ 538us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.197106 (+ 26us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.197199 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.197366 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":419,"threads_started":1}
I20260805 23:01:16.236024 839 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:16.236334 839 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47314:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:16.240144 839 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Sending DeleteTablet for 3 replicas of tablet f403dbfd4d7b4df89301c78cf500ed92
I20260805 23:01:16.241199 1210 tablet_service.cc:1514] Processing DeleteTablet for tablet f403dbfd4d7b4df89301c78cf500ed92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:38442
I20260805 23:01:16.241228 1024 tablet_service.cc:1514] Processing DeleteTablet for tablet f403dbfd4d7b4df89301c78cf500ed92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:37198
I20260805 23:01:16.241279 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet f403dbfd4d7b4df89301c78cf500ed92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:45948
I20260805 23:01:16.253953 1645 tablet_replica.cc:330] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: stopping tablet replica
I20260805 23:01:16.254369 1645 raft_consensus.cc:2229] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:01:16.254882 1645 raft_consensus.cc:2258] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.256382 1645 ts_tablet_manager.cc:1905] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.264019 1645 ts_tablet_manager.cc:1918] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:01:16.264361 1645 log.cc:1196] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/f403dbfd4d7b4df89301c78cf500ed92
I20260805 23:01:16.264981 1645 ts_tablet_manager.cc:1939] T f403dbfd4d7b4df89301c78cf500ed92 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting consensus metadata
I20260805 23:01:16.266510 824 catalog_manager.cc:4841] TS ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631): tablet f403dbfd4d7b4df89301c78cf500ed92 (table test-table [id=5e5ce5475b334e9e9836c90fa07ed9d5]) successfully deleted
I20260805 23:01:16.271901 1644 tablet_replica.cc:330] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: stopping tablet replica
I20260805 23:01:16.272127 1644 raft_consensus.cc:2229] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:16.272421 1644 raft_consensus.cc:2258] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.273123 1642 tablet_replica.cc:330] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: stopping tablet replica
I20260805 23:01:16.273924 1644 ts_tablet_manager.cc:1905] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.279155 1642 raft_consensus.cc:2229] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:16.279480 1644 ts_tablet_manager.cc:1918] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:01:16.279623 1644 log.cc:1196] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/f403dbfd4d7b4df89301c78cf500ed92
I20260805 23:01:16.279742 1642 raft_consensus.cc:2258] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.280154 1644 ts_tablet_manager.cc:1939] T f403dbfd4d7b4df89301c78cf500ed92 P 762c586ab75b4fccb05118e0e4da9785: Deleting consensus metadata
I20260805 23:01:16.281172 1642 ts_tablet_manager.cc:1905] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.281370 823 catalog_manager.cc:4841] TS 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971): tablet f403dbfd4d7b4df89301c78cf500ed92 (table test-table [id=5e5ce5475b334e9e9836c90fa07ed9d5]) successfully deleted
I20260805 23:01:16.287909 1642 ts_tablet_manager.cc:1918] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:01:16.288084 1642 log.cc:1196] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/f403dbfd4d7b4df89301c78cf500ed92
I20260805 23:01:16.288618 1642 ts_tablet_manager.cc:1939] T f403dbfd4d7b4df89301c78cf500ed92 P 89a464783be34e309033ddf0b1e0b785: Deleting consensus metadata
I20260805 23:01:16.289841 822 catalog_manager.cc:4841] TS 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977): tablet f403dbfd4d7b4df89301c78cf500ed92 (table test-table [id=5e5ce5475b334e9e9836c90fa07ed9d5]) successfully deleted
Aug 05 23:01:16 dist-test-slave-1vmg krb5kdc[776](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 05 23:01:16 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:16 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 23:01:16.335068 1655 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:16.321967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47326 (local address 127.22.45.126:38269)
0805 23:01:16.322731 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.322736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.322756 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:01:16.322814 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.322818 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.322878 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.323011 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:16.324819 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.325700 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.327628 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.328055 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.328155 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.334714 (+ 6559us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47326: BlockingRecv error: recv got EOF from 127.0.0.1:47326 (error 108)
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":543,"threads_started":1}
Aug 05 23:01:16 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM
I20260805 23:01:16.355827 1655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.338289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47334 (local address 127.22.45.126:38269)
0805 23:01:16.338513 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.338520 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.339194 (+ 674us) server_negotiation.cc:407] Connection header received
0805 23:01:16.339388 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.339392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.339459 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.339545 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:16.341319 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.342126 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.344079 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.344677 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.344813 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.349955 (+ 5142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:16.349961 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:16.349964 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:16.350010 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:16.352924 (+ 2914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:16.353733 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:16.353737 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:16.353739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:16.353874 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:16.354274 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:16.354277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:16.354280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:16.354602 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:16.354873 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.355238 (+ 365us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.355485 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 23:01:16.360066 839 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:01:16.360725 839 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:16.368429 1210 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f (DEFAULT_TABLE table=test-table [id=b40a3f697f8a40eb9a740f553317247d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:16.368620 1024 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f (DEFAULT_TABLE table=test-table [id=b40a3f697f8a40eb9a740f553317247d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:16.368988 1210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6e2ba23c824331ba184b48e7cdd80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:16.369161 1024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6e2ba23c824331ba184b48e7cdd80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:16.372023 1411 tablet_service.cc:1467] Processing CreateTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f (DEFAULT_TABLE table=test-table [id=b40a3f697f8a40eb9a740f553317247d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:16.372519 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a6e2ba23c824331ba184b48e7cdd80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:16.386720 1664 tablet_bootstrap.cc:492] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: Bootstrap starting.
I20260805 23:01:16.388870 1666 tablet_bootstrap.cc:492] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: Bootstrap starting.
I20260805 23:01:16.389820 1664 tablet_bootstrap.cc:654] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:16.390522 1665 tablet_bootstrap.cc:492] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: Bootstrap starting.
I20260805 23:01:16.392434 1665 tablet_bootstrap.cc:654] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:16.392861 1666 tablet_bootstrap.cc:654] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:16.394533 1664 tablet_bootstrap.cc:492] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: No bootstrap required, opened a new log
I20260805 23:01:16.394822 1664 ts_tablet_manager.cc:1397] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260805 23:01:16.394963 1665 tablet_bootstrap.cc:492] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: No bootstrap required, opened a new log
I20260805 23:01:16.395123 1665 ts_tablet_manager.cc:1397] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s
I20260805 23:01:16.395787 1664 raft_consensus.cc:348] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.396049 1664 raft_consensus.cc:374] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:16.395972 1665 raft_consensus.cc:348] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.396165 1664 raft_consensus.cc:729] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad84f6fe90f4447ea1fcf1ada7054fe6, State: Initialized, Role: FOLLOWER
I20260805 23:01:16.396272 1665 raft_consensus.cc:374] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:16.396368 1665 raft_consensus.cc:729] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762c586ab75b4fccb05118e0e4da9785, State: Initialized, Role: FOLLOWER
I20260805 23:01:16.396502 1664 consensus_queue.cc:260] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.396675 1665 consensus_queue.cc:260] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.397399 1665 ts_tablet_manager.cc:1428] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260805 23:01:16.398378 1664 ts_tablet_manager.cc:1428] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260805 23:01:16.400568 1666 tablet_bootstrap.cc:492] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: No bootstrap required, opened a new log
I20260805 23:01:16.400887 1666 ts_tablet_manager.cc:1397] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.000s
I20260805 23:01:16.401926 1666 raft_consensus.cc:348] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.402259 1666 raft_consensus.cc:374] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:16.402388 1666 raft_consensus.cc:729] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Initialized, Role: FOLLOWER
I20260805 23:01:16.402757 1666 consensus_queue.cc:260] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.403507 1666 ts_tablet_manager.cc:1428] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 23:01:16.538688 1634 raft_consensus.cc:482] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:16.539021 1634 raft_consensus.cc:504] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.539963 1634 leader_election.cc:288] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:16.540593 1244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6e2ba23c824331ba184b48e7cdd80f" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" is_pre_election: true
I20260805 23:01:16.540634 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6e2ba23c824331ba184b48e7cdd80f" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785" is_pre_election: true
I20260805 23:01:16.540876 1244 raft_consensus.cc:2454] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 0.
I20260805 23:01:16.540895 1437 raft_consensus.cc:2454] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 0.
I20260805 23:01:16.541406 963 leader_election.cc:302] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:16.541730 1634 raft_consensus.cc:2781] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:16.541857 1634 raft_consensus.cc:482] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:16.541963 1634 raft_consensus.cc:3037] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.544593 1634 raft_consensus.cc:504] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.545222 1634 leader_election.cc:288] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 election: Requested vote from peers ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:16.545819 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6e2ba23c824331ba184b48e7cdd80f" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785"
I20260805 23:01:16.545821 1244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a6e2ba23c824331ba184b48e7cdd80f" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6"
I20260805 23:01:16.546026 1437 raft_consensus.cc:3037] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.546073 1244 raft_consensus.cc:3037] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.548382 1437 raft_consensus.cc:2454] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 1.
I20260805 23:01:16.548923 962 leader_election.cc:302] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 762c586ab75b4fccb05118e0e4da9785, 89a464783be34e309033ddf0b1e0b785; no voters:
I20260805 23:01:16.549242 1634 raft_consensus.cc:2781] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:16.549243 1244 raft_consensus.cc:2454] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 1.
I20260805 23:01:16.549396 1634 raft_consensus.cc:686] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 1 LEADER]: Becoming Leader. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Running, Role: LEADER
I20260805 23:01:16.549691 1634 consensus_queue.cc:237] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.552425 839 catalog_manager.cc:5495] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89a464783be34e309033ddf0b1e0b785 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } health_report { overall_health: UNKNOWN } } }
I20260805 23:01:16.578595 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.573581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37218 (local address 127.22.45.65:34977)
0805 23:01:16.573798 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.573803 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.573875 (+ 72us) server_negotiation.cc:407] Connection header received
0805 23:01:16.574146 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.574150 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.574223 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.574301 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:16.574674 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.575458 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.576816 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.577259 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.577360 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.577862 (+ 502us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.577999 (+ 137us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.578082 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.578234 (+ 152us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.578306 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 23:01:16.582118 1244 raft_consensus.cc:1261] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Refusing update from remote peer 89a464783be34e309033ddf0b1e0b785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.582183 1437 raft_consensus.cc:1261] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Refusing update from remote peer 89a464783be34e309033ddf0b1e0b785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.582796 1626 consensus_queue.cc:1035] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.583182 1634 consensus_queue.cc:1035] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.599210 840 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:16.599499 840 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:16.604137 840 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Sending DeleteTablet for 3 replicas of tablet 6a6e2ba23c824331ba184b48e7cdd80f
I20260805 23:01:16.605217 1210 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:38442
I20260805 23:01:16.605326 1211 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:38442
I20260805 23:01:16.605571 1645 tablet_replica.cc:330] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: stopping tablet replica
I20260805 23:01:16.605814 1645 raft_consensus.cc:2229] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:16.606074 1645 raft_consensus.cc:2258] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.606061 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:45948
I20260805 23:01:16.606397 1644 tablet_replica.cc:330] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: stopping tablet replica
I20260805 23:01:16.606612 1644 raft_consensus.cc:2229] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:16.606894 1024 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:37198
I20260805 23:01:16.607031 1025 tablet_service.cc:1514] Processing DeleteTablet for tablet 6a6e2ba23c824331ba184b48e7cdd80f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:37198
I20260805 23:01:16.606863 1644 raft_consensus.cc:2258] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.607256 1642 tablet_replica.cc:330] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: stopping tablet replica
I20260805 23:01:16.607651 1642 raft_consensus.cc:2229] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:01:16.608304 1642 raft_consensus.cc:2258] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.609076 1644 ts_tablet_manager.cc:1905] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.609545 1642 ts_tablet_manager.cc:1905] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.609539 839 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47334:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:01:16.610649 839 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:16.612943 1645 ts_tablet_manager.cc:1905] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.618057 1644 ts_tablet_manager.cc:1918] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:16.618264 1644 log.cc:1196] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/6a6e2ba23c824331ba184b48e7cdd80f
I20260805 23:01:16.618332 1642 ts_tablet_manager.cc:1918] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:16.618500 1642 log.cc:1196] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/6a6e2ba23c824331ba184b48e7cdd80f
I20260805 23:01:16.618728 1644 ts_tablet_manager.cc:1939] T 6a6e2ba23c824331ba184b48e7cdd80f P 762c586ab75b4fccb05118e0e4da9785: Deleting consensus metadata
I20260805 23:01:16.618969 1642 ts_tablet_manager.cc:1939] T 6a6e2ba23c824331ba184b48e7cdd80f P 89a464783be34e309033ddf0b1e0b785: Deleting consensus metadata
I20260805 23:01:16.620159 823 catalog_manager.cc:4841] TS 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971): tablet 6a6e2ba23c824331ba184b48e7cdd80f (table test-table [id=b40a3f697f8a40eb9a740f553317247d]) successfully deleted
I20260805 23:01:16.620630 822 catalog_manager.cc:4841] TS 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977): tablet 6a6e2ba23c824331ba184b48e7cdd80f (table test-table [id=b40a3f697f8a40eb9a740f553317247d]) successfully deleted
W20260805 23:01:16.621069 822 catalog_manager.cc:4808] TS 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977): delete failed for tablet 6a6e2ba23c824331ba184b48e7cdd80f because the tablet was not found. No further retry: Not found: Tablet not found: 6a6e2ba23c824331ba184b48e7cdd80f
I20260805 23:01:16.623679 1645 ts_tablet_manager.cc:1918] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:16.624024 1645 log.cc:1196] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/6a6e2ba23c824331ba184b48e7cdd80f
I20260805 23:01:16.625957 1025 tablet_service.cc:1467] Processing CreateTablet for tablet b184b6dce9844c57a510acf56dee8445 (DEFAULT_TABLE table=test-table [id=dfc9f14a750e48dea75a9e831013ba57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:16.626289 1411 tablet_service.cc:1467] Processing CreateTablet for tablet b184b6dce9844c57a510acf56dee8445 (DEFAULT_TABLE table=test-table [id=dfc9f14a750e48dea75a9e831013ba57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:16.626513 1025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b184b6dce9844c57a510acf56dee8445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:16.626423 1211 tablet_service.cc:1467] Processing CreateTablet for tablet b184b6dce9844c57a510acf56dee8445 (DEFAULT_TABLE table=test-table [id=dfc9f14a750e48dea75a9e831013ba57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:16.626865 1411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b184b6dce9844c57a510acf56dee8445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:16.627104 1211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b184b6dce9844c57a510acf56dee8445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:16.633513 1665 tablet_bootstrap.cc:492] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: Bootstrap starting.
I20260805 23:01:16.634032 1664 tablet_bootstrap.cc:492] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: Bootstrap starting.
I20260805 23:01:16.634660 1645 ts_tablet_manager.cc:1939] T 6a6e2ba23c824331ba184b48e7cdd80f P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting consensus metadata
I20260805 23:01:16.635090 1665 tablet_bootstrap.cc:654] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:16.635777 1664 tablet_bootstrap.cc:654] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:16.635986 824 catalog_manager.cc:4841] TS ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631): tablet 6a6e2ba23c824331ba184b48e7cdd80f (table test-table [id=b40a3f697f8a40eb9a740f553317247d]) successfully deleted
W20260805 23:01:16.636518 824 catalog_manager.cc:4808] TS ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631): delete failed for tablet 6a6e2ba23c824331ba184b48e7cdd80f because the tablet was not found. No further retry: Not found: Tablet not found: 6a6e2ba23c824331ba184b48e7cdd80f
I20260805 23:01:16.637354 1666 tablet_bootstrap.cc:492] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: Bootstrap starting.
I20260805 23:01:16.638134 1665 tablet_bootstrap.cc:492] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: No bootstrap required, opened a new log
I20260805 23:01:16.638312 1665 ts_tablet_manager.cc:1397] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260805 23:01:16.639094 1666 tablet_bootstrap.cc:654] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:16.639124 1665 raft_consensus.cc:348] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.639401 1665 raft_consensus.cc:374] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:16.639488 1665 raft_consensus.cc:729] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762c586ab75b4fccb05118e0e4da9785, State: Initialized, Role: FOLLOWER
I20260805 23:01:16.639760 1665 consensus_queue.cc:260] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.640311 1665 ts_tablet_manager.cc:1428] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 23:01:16.641821 1664 tablet_bootstrap.cc:492] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: No bootstrap required, opened a new log
I20260805 23:01:16.642001 1664 ts_tablet_manager.cc:1397] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.001s
I20260805 23:01:16.642777 1664 raft_consensus.cc:348] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.643471 1664 raft_consensus.cc:374] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:16.643600 1664 raft_consensus.cc:729] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad84f6fe90f4447ea1fcf1ada7054fe6, State: Initialized, Role: FOLLOWER
I20260805 23:01:16.643906 1664 consensus_queue.cc:260] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.644575 1664 ts_tablet_manager.cc:1428] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260805 23:01:16.653946 1666 tablet_bootstrap.cc:492] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: No bootstrap required, opened a new log
I20260805 23:01:16.654194 1666 ts_tablet_manager.cc:1397] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.006s
I20260805 23:01:16.655069 1666 raft_consensus.cc:348] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.655284 1666 raft_consensus.cc:374] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:16.655371 1666 raft_consensus.cc:729] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Initialized, Role: FOLLOWER
I20260805 23:01:16.655608 1666 consensus_queue.cc:260] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.656093 1666 ts_tablet_manager.cc:1428] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260805 23:01:16.756296 1634 raft_consensus.cc:482] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:16.756559 1634 raft_consensus.cc:504] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.757275 1634 leader_election.cc:288] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:16.757939 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184b6dce9844c57a510acf56dee8445" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785" is_pre_election: true
I20260805 23:01:16.757936 1244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184b6dce9844c57a510acf56dee8445" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" is_pre_election: true
I20260805 23:01:16.758198 1437 raft_consensus.cc:2454] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 0.
I20260805 23:01:16.758211 1244 raft_consensus.cc:2454] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 0.
I20260805 23:01:16.758656 963 leader_election.cc:302] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:16.758975 1634 raft_consensus.cc:2781] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:16.759112 1634 raft_consensus.cc:482] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:16.759202 1634 raft_consensus.cc:3037] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.762440 1634 raft_consensus.cc:504] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.763178 1634 leader_election.cc:288] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 election: Requested vote from peers ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631), 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971)
I20260805 23:01:16.763787 1244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184b6dce9844c57a510acf56dee8445" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6"
I20260805 23:01:16.763803 1437 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b184b6dce9844c57a510acf56dee8445" candidate_uuid: "89a464783be34e309033ddf0b1e0b785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "762c586ab75b4fccb05118e0e4da9785"
I20260805 23:01:16.764021 1437 raft_consensus.cc:3037] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.764050 1244 raft_consensus.cc:3037] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:16.767073 1437 raft_consensus.cc:2454] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 1.
I20260805 23:01:16.767063 1244 raft_consensus.cc:2454] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89a464783be34e309033ddf0b1e0b785 in term 1.
I20260805 23:01:16.767676 963 leader_election.cc:302] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 762c586ab75b4fccb05118e0e4da9785, 89a464783be34e309033ddf0b1e0b785, ad84f6fe90f4447ea1fcf1ada7054fe6; no voters:
I20260805 23:01:16.768071 1634 raft_consensus.cc:2781] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:16.768343 1634 raft_consensus.cc:686] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 1 LEADER]: Becoming Leader. State: Replica: 89a464783be34e309033ddf0b1e0b785, State: Running, Role: LEADER
I20260805 23:01:16.768667 1634 consensus_queue.cc:237] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } }
I20260805 23:01:16.771858 839 catalog_manager.cc:5495] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89a464783be34e309033ddf0b1e0b785 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "89a464783be34e309033ddf0b1e0b785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89a464783be34e309033ddf0b1e0b785" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 } health_report { overall_health: UNKNOWN } } }
I20260805 23:01:16.837803 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.821164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:32867 (local address 127.22.45.65:34977)
0805 23:01:16.831085 (+ 9921us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.831090 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.831117 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:01:16.831213 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.831217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.831294 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.831410 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:16.832067 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.833243 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.835471 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.836232 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.836365 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.836876 (+ 511us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.837036 (+ 160us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.837125 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.837259 (+ 134us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.837359 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":9783}
I20260805 23:01:16.838017 1683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.820797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:34977 (local address 127.22.45.65:32867)
0805 23:01:16.821515 (+ 718us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:16.821540 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:16.821666 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:16.831448 (+ 9782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:16.831453 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:16.831466 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0805 23:01:16.831888 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.831900 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.833419 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.833424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.835305 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:16.835321 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.836459 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.836466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:16.836650 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.836707 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0805 23:01:16.837142 (+ 435us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0805 23:01:16.837154 (+ 12us) client_negotiation.cc:769] Sending connection context
0805 23:01:16.837226 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 23:01:16.837391 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"mutex_wait_us":1,"thread_start_us":412,"threads_started":1}
I20260805 23:01:16.847748 1437 raft_consensus.cc:1261] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Refusing update from remote peer 89a464783be34e309033ddf0b1e0b785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.848021 1244 raft_consensus.cc:1261] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Refusing update from remote peer 89a464783be34e309033ddf0b1e0b785: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:16.848471 1626 consensus_queue.cc:1035] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "762c586ab75b4fccb05118e0e4da9785" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45971 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.848989 1556 consensus_queue.cc:1035] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ad84f6fe90f4447ea1fcf1ada7054fe6" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 39631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:16.911870 839 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:16.912230 839 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47334:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:16.915792 839 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74dd9f7278fa4dabb59f61737d5ad61b: Sending DeleteTablet for 3 replicas of tablet b184b6dce9844c57a510acf56dee8445
I20260805 23:01:16.916872 1211 tablet_service.cc:1514] Processing DeleteTablet for tablet b184b6dce9844c57a510acf56dee8445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:38442
I20260805 23:01:16.916985 1025 tablet_service.cc:1514] Processing DeleteTablet for tablet b184b6dce9844c57a510acf56dee8445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:37198
I20260805 23:01:16.917238 1645 tablet_replica.cc:330] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: stopping tablet replica
I20260805 23:01:16.917337 1642 tablet_replica.cc:330] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: stopping tablet replica
I20260805 23:01:16.917439 1645 raft_consensus.cc:2229] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:16.917507 1642 raft_consensus.cc:2229] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:01:16.917667 1645 raft_consensus.cc:2258] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.917904 1642 raft_consensus.cc:2258] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.919572 1645 ts_tablet_manager.cc:1905] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.923815 1642 ts_tablet_manager.cc:1905] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.924158 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 938
I20260805 23:01:16.925704 1411 tablet_service.cc:1514] Processing DeleteTablet for tablet b184b6dce9844c57a510acf56dee8445 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:16 UTC) from {username='oryx', principal='oryx/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:45948
I20260805 23:01:16.926065 1644 tablet_replica.cc:330] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: stopping tablet replica
I20260805 23:01:16.926296 1644 raft_consensus.cc:2229] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:16.926550 1644 raft_consensus.cc:2258] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:16.926785 1645 ts_tablet_manager.cc:1918] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:01:16.927038 1645 log.cc:1196] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/b184b6dce9844c57a510acf56dee8445
I20260805 23:01:16.927564 1645 ts_tablet_manager.cc:1939] T b184b6dce9844c57a510acf56dee8445 P ad84f6fe90f4447ea1fcf1ada7054fe6: Deleting consensus metadata
I20260805 23:01:16.931557 824 catalog_manager.cc:4841] TS ad84f6fe90f4447ea1fcf1ada7054fe6 (127.22.45.66:39631): tablet b184b6dce9844c57a510acf56dee8445 (table test-table [id=dfc9f14a750e48dea75a9e831013ba57]) successfully deleted
I20260805 23:01:16.932844 1644 ts_tablet_manager.cc:1905] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:16.933259 1642 ts_tablet_manager.cc:1918] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:01:16.933442 1642 log.cc:1196] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/b184b6dce9844c57a510acf56dee8445
I20260805 23:01:16.933943 1642 ts_tablet_manager.cc:1939] T b184b6dce9844c57a510acf56dee8445 P 89a464783be34e309033ddf0b1e0b785: Deleting consensus metadata
I20260805 23:01:16.935426 822 catalog_manager.cc:4841] TS 89a464783be34e309033ddf0b1e0b785 (127.22.45.65:34977): tablet b184b6dce9844c57a510acf56dee8445 (table test-table [id=dfc9f14a750e48dea75a9e831013ba57]) successfully deleted
I20260805 23:01:16.938951 1644 ts_tablet_manager.cc:1918] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260805 23:01:16.939148 1644 log.cc:1196] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/b184b6dce9844c57a510acf56dee8445
I20260805 23:01:16.939539 1644 ts_tablet_manager.cc:1939] T b184b6dce9844c57a510acf56dee8445 P 762c586ab75b4fccb05118e0e4da9785: Deleting consensus metadata
Aug 05 23:01:16 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.65@KRBTEST.COM
I20260805 23:01:16.940742 823 catalog_manager.cc:4841] TS 762c586ab75b4fccb05118e0e4da9785 (127.22.45.67:45971): tablet b184b6dce9844c57a510acf56dee8445 (table test-table [id=dfc9f14a750e48dea75a9e831013ba57]) successfully deleted
I20260805 23:01:16.949327 1604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:16.926567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37226 (local address 127.22.45.65:34977)
0805 23:01:16.926877 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:16.926883 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:16.929163 (+ 2280us) server_negotiation.cc:407] Connection header received
0805 23:01:16.929501 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:16.929508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:16.929639 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:16.929728 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:16.931671 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.932691 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.934958 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:16.935684 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:16.935795 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:16.941610 (+ 5815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:16.941635 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:16.941658 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:16.941711 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:16.945982 (+ 4271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:16.946862 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:16.946875 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:16.946879 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:16.947110 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:16.947524 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:16.947530 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:16.947534 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:16.948119 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:16.948433 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:16.948710 (+ 277us) server_negotiation.cc:299] Negotiation successful
0805 23:01:16.948973 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173}
I20260805 23:01:16.950151 1117 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:17.107191 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 938
I20260805 23:01:17.140712 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 1129
Aug 05 23:01:17 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.66@KRBTEST.COM
I20260805 23:01:17.157305 1691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:17.141511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38452 (local address 127.22.45.66:39631)
0805 23:01:17.142044 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:17.142050 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:17.142072 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:01:17.142134 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:17.142139 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:17.142228 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:17.142352 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:17.143590 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:17.144701 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:17.145921 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:17.146588 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:17.146713 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:17.151462 (+ 4749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:17.151481 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:17.151498 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:17.151541 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:17.154347 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:17.155248 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:17.155257 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:17.155259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:17.155404 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:17.155755 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:17.155759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:17.155761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:17.156166 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:17.156416 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:17.156765 (+ 349us) server_negotiation.cc:299] Negotiation successful
0805 23:01:17.156963 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":246,"threads_started":1}
I20260805 23:01:17.158118 1300 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:17.286249 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 1129
I20260805 23:01:17.313992 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 1313
Aug 05 23:01:17 dist-test-slave-1vmg krb5kdc[776](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.45.67@KRBTEST.COM
I20260805 23:01:17.331426 1694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:17.314823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45960 (local address 127.22.45.67:45971)
0805 23:01:17.315317 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:17.315322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:17.315338 (+ 16us) server_negotiation.cc:407] Connection header received
0805 23:01:17.315395 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:17.315399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:17.315472 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:17.315568 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:17.316791 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:17.317580 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:17.318847 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:17.319391 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:17.319492 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:17.323952 (+ 4460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:17.323971 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:17.323990 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:17.324038 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:17.327449 (+ 3411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:17.328560 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:17.328572 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:17.328575 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:17.328788 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:17.329240 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:17.329244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:17.329248 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:17.329886 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:17.330245 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:17.330701 (+ 456us) server_negotiation.cc:299] Negotiation successful
0805 23:01:17.331027 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":398,"thread_start_us":274,"threads_started":1}
I20260805 23:01:17.332324 1504 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:17.434633 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 1313
I20260805 23:01:17.454367 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 798
I20260805 23:01:17.455725 894 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:17.582475 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 798
2026-08-05T23:01:17Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7398 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:01:17 dist-test-slave-1vmg krb5kdc[1702](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:01:17 dist-test-slave-1vmg krb5kdc[1702](info): set up 2 sockets
Aug 05 23:01:17 dist-test-slave-1vmg krb5kdc[1702](info): commencing operation
krb5kdc: starting...
W20260805 23:01:18.791366 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.158s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:01:18 dist-test-slave-1vmg krb5kdc[1702](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:01:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:01:19.070565 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:33245
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:32853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:33245
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:19.442881 1721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:19.443295 1721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:19.443437 1721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:19.451427 1721 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:19.451578 1721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:19.451627 1721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:19.451723 1721 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:19.451797 1721 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:19.462257 1721 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:32853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:33245
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:33245
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:19.463755 1721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:19.465279 1721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:19.479225 1733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:19.479169 1729 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:19.479133 1726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:19.480417 1721 server_base.cc:1034] running on GCE node
I20260805 23:01:19.481392 1721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:19.483192 1721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:19.484584 1721 hybrid_clock.cc:648] HybridClock initialized: now 1785970879484522 us; error 53 us; skew 500 ppm
I20260805 23:01:19.485064 1721 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-05T23:01:19Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1978 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:01:19 dist-test-slave-1vmg krb5kdc[1742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:01:19 dist-test-slave-1vmg krb5kdc[1742](info): set up 2 sockets
Aug 05 23:01:19 dist-test-slave-1vmg krb5kdc[1742](info): commencing operation
krb5kdc: starting...
W20260805 23:01:20.783964 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.002s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:01:20 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:01:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:01:21.071053 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45961
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:45961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:21.431257 1757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:21.431639 1757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:21.431785 1757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:21.439472 1757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:21.439620 1757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:21.439706 1757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:21.439807 1757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:21.439870 1757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:21.450150 1757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:45961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:21.451634 1757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:21.453001 1757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:21.465407 1763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:21.465445 1766 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:21.465485 1764 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:21.466425 1757 server_base.cc:1034] running on GCE node
I20260805 23:01:21.467393 1757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:21.469015 1757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:21.470252 1757 hybrid_clock.cc:648] HybridClock initialized: now 1785970881470198 us; error 35 us; skew 500 ppm
I20260805 23:01:21.470679 1757 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:21 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970881, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:21.474525 1757 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:01:21.476578 1757 webserver.cc:460] Webserver started at http://127.22.45.126:32863/ using document root <none> and password file <none>
I20260805 23:01:21.477448 1757 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:21.477926 1757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:21.478369 1757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:21.483213 1757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "6e42b3b2d7cf499197045f4004da46dc"
format_stamp: "Formatted at 2026-08-05 23:01:21 on dist-test-slave-1vmg"
server_key: "fb8d1bf3c6a4b36b4b2a709ff3e7ad7b"
server_key_iv: "571f19cced593beac639623bc8896b38"
server_key_version: "encryptionkey@0"
I20260805 23:01:21.484189 1757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "6e42b3b2d7cf499197045f4004da46dc"
format_stamp: "Formatted at 2026-08-05 23:01:21 on dist-test-slave-1vmg"
server_key: "fb8d1bf3c6a4b36b4b2a709ff3e7ad7b"
server_key_iv: "571f19cced593beac639623bc8896b38"
server_key_version: "encryptionkey@0"
I20260805 23:01:21.490638 1757 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:01:21.494993 1775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:21.496575 1757 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:01:21.496793 1757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "6e42b3b2d7cf499197045f4004da46dc"
format_stamp: "Formatted at 2026-08-05 23:01:21 on dist-test-slave-1vmg"
server_key: "fb8d1bf3c6a4b36b4b2a709ff3e7ad7b"
server_key_iv: "571f19cced593beac639623bc8896b38"
server_key_version: "encryptionkey@0"
I20260805 23:01:21.497025 1757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:21.527475 1757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:21.532461 1757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:21.532792 1757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:21.551853 1757 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:45961
I20260805 23:01:21.551877 1849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:45961 every 8 connection(s)
I20260805 23:01:21.553429 1757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:01:21.557695 1852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:21.562189 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 1757
I20260805 23:01:21.562431 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:01:21.563114 22709 external_mini_cluster.cc:1428] Setting key d1a731d9ec8e994161005ab5d9cd8751
I20260805 23:01:21.570004 1852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Bootstrap starting.
I20260805 23:01:21.574128 1852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:21.575549 1852 log.cc:824] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:21.578816 1852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: No bootstrap required, opened a new log
Aug 05 23:01:21 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:21.587056 1852 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:21.587532 1852 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:21.587644 1852 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e42b3b2d7cf499197045f4004da46dc, State: Initialized, Role: FOLLOWER
I20260805 23:01:21.588260 1852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:21.588495 1852 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:01:21.588615 1857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:21.565483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35776 (local address 127.22.45.126:45961)
0805 23:01:21.566396 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:21.566412 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:21.566460 (+ 48us) server_negotiation.cc:407] Connection header received
0805 23:01:21.568456 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:21.568484 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:21.568989 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:21.569365 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:21.571468 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:21.572886 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:21.574744 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:21.575643 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:21.575906 (+ 263us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:21.580438 (+ 4532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:21.580447 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:21.580465 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:21.580511 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:21.583961 (+ 3450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:21.584808 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:21.584817 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:21.584824 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:21.585015 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:21.585409 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:21.585414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:21.585416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:21.586073 (+ 657us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:21.586400 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:21.586842 (+ 442us) server_negotiation.cc:299] Negotiation successful
0805 23:01:21.587353 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":380,"threads_started":1}
I20260805 23:01:21.588640 1852 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:01:21.588898 1852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:21.591414 1852 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:21.591982 1852 leader_election.cc:302] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e42b3b2d7cf499197045f4004da46dc; no voters:
I20260805 23:01:21.592537 1852 leader_election.cc:288] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:01:21.592669 1859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:21.593317 1859 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 LEADER]: Becoming Leader. State: Replica: 6e42b3b2d7cf499197045f4004da46dc, State: Running, Role: LEADER
I20260805 23:01:21.593837 1859 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:21.594594 1852 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:21.596484 1860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e42b3b2d7cf499197045f4004da46dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } } }
I20260805 23:01:21.596982 1860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:21.596835 1862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e42b3b2d7cf499197045f4004da46dc. Latest consensus state: current_term: 1 leader_uuid: "6e42b3b2d7cf499197045f4004da46dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } } }
I20260805 23:01:21.597100 1862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:21.599269 1868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:21.605137 1868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:21.615825 1868 catalog_manager.cc:1347] Generated new cluster ID: 8078ac7402964183970d5ddb8548da2a
I20260805 23:01:21.616065 1868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:21.636855 1868 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:01:21.638891 1868 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:21.656399 1868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Generated new TSK 0
I20260805 23:01:21.657608 1868 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:01:21.726634 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:45961
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:22.086593 1888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:22.087003 1888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:22.087167 1888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:22.094997 1888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:22.095148 1888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:22.095316 1888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:22.106276 1888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:45961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:22.107846 1888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:22.109338 1888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:22.124416 1897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:22.124377 1896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:22.124334 1899 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:22.130617 1888 server_base.cc:1034] running on GCE node
I20260805 23:01:22.131482 1888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:22.132628 1888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:22.133860 1888 hybrid_clock.cc:648] HybridClock initialized: now 1785970882133813 us; error 52 us; skew 500 ppm
I20260805 23:01:22.134241 1888 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:22 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970882, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:22.137959 1888 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:01:22.139911 1888 webserver.cc:460] Webserver started at http://127.22.45.65:34585/ using document root <none> and password file <none>
I20260805 23:01:22.140763 1888 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:22.140900 1888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:22.141249 1888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:22.144711 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "89a55efaeb7e419fac777a59b06b4947"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "cc3378269a0b0b833aeadf1d64309a16"
server_key_iv: "3bfa9d57d0145f6c0a6676eba27e9bde"
server_key_version: "encryptionkey@0"
I20260805 23:01:22.146108 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "89a55efaeb7e419fac777a59b06b4947"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "cc3378269a0b0b833aeadf1d64309a16"
server_key_iv: "3bfa9d57d0145f6c0a6676eba27e9bde"
server_key_version: "encryptionkey@0"
I20260805 23:01:22.152522 1888 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:01:22.157168 1908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:22.159122 1888 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:01:22.159366 1888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "89a55efaeb7e419fac777a59b06b4947"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "cc3378269a0b0b833aeadf1d64309a16"
server_key_iv: "3bfa9d57d0145f6c0a6676eba27e9bde"
server_key_version: "encryptionkey@0"
I20260805 23:01:22.159598 1888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:22.177145 1888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:22.181751 1888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:22.182066 1888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:22.183202 1888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:22.184753 1888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:22.184844 1888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:22.184978 1888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:22.185034 1888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:22.218353 1888 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:35499
I20260805 23:01:22.218392 2063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:35499 every 8 connection(s)
I20260805 23:01:22.219858 1888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:22.227614 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 1888
I20260805 23:01:22.227823 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:01:22.228513 22709 external_mini_cluster.cc:1428] Setting key e619520cb02121a910c0f5374e1ab03c
Aug 05 23:01:22 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970882, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:22.241822 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:22.222851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:43433 (local address 127.22.45.126:45961)
0805 23:01:22.223389 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:22.223394 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:22.224472 (+ 1078us) server_negotiation.cc:407] Connection header received
0805 23:01:22.226460 (+ 1988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:22.226466 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:22.226557 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:22.226664 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:22.228519 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.229320 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.231047 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.231485 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.231612 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:22.235698 (+ 4086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:22.235705 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:22.235709 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:22.235747 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:22.238334 (+ 2587us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:22.239253 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:22.239258 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:22.239261 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:22.239395 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:22.239878 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:22.239882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:22.239884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:22.240177 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:22.240331 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:22.241162 (+ 831us) server_negotiation.cc:299] Negotiation successful
0805 23:01:22.241443 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":259,"threads_started":1}
I20260805 23:01:22.242976 2067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:22.223478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:43433)
0805 23:01:22.224271 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:22.224322 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:22.226123 (+ 1801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:22.226987 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:22.226999 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:22.227604 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:22.228313 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:22.228332 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.229500 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.229504 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:22.230854 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:22.230869 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.231757 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.231765 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:22.232015 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:22.232749 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:22.232774 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:22.235398 (+ 2624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:22.238514 (+ 3116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:22.238525 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:22.238542 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:22.239095 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:22.239512 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:22.239516 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:22.239518 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:22.239751 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:22.240327 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:22.240337 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:22.240741 (+ 404us) client_negotiation.cc:769] Sending connection context
0805 23:01:22.241007 (+ 266us) client_negotiation.cc:240] Negotiation successful
0805 23:01:22.241628 (+ 621us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":296,"threads_started":1}
I20260805 23:01:22.244975 2064 heartbeater.cc:347] Connected to a master server at 127.22.45.126:45961
I20260805 23:01:22.245317 2064 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:22.246129 2064 heartbeater.cc:511] Master 127.22.45.126:45961 requested a full tablet report, sending...
I20260805 23:01:22.248914 1800 ts_manager.cc:194] Registered new tserver with Master: 89a55efaeb7e419fac777a59b06b4947 (127.22.45.65:35499)
I20260805 23:01:22.251200 1800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:43433
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:01:22.289758 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:45961
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:22.652896 2071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:22.653262 2071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:22.653396 2071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:22.661127 2071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:22.661291 2071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:22.661450 2071 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:22.671690 2071 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:45961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:22.673177 2071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:22.674536 2071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:22.688838 2078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:22.688791 2080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:22.689421 2077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:22.689889 2071 server_base.cc:1034] running on GCE node
I20260805 23:01:22.690623 2071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:22.691839 2071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:22.693069 2071 hybrid_clock.cc:648] HybridClock initialized: now 1785970882693019 us; error 75 us; skew 500 ppm
I20260805 23:01:22.693436 2071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:22 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970882, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:22.697331 2071 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:01:22.699257 2071 webserver.cc:460] Webserver started at http://127.22.45.66:43457/ using document root <none> and password file <none>
I20260805 23:01:22.700155 2071 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:22.700286 2071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:22.700639 2071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:22.704021 2071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "8e11f64983bb46f7897faa3352c3e2c7"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "b0cbb4771b2eaf9e9c9bbe3a20645d12"
server_key_iv: "66884d334cfdf2caca7752e43d2a50eb"
server_key_version: "encryptionkey@0"
I20260805 23:01:22.704927 2071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "8e11f64983bb46f7897faa3352c3e2c7"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "b0cbb4771b2eaf9e9c9bbe3a20645d12"
server_key_iv: "66884d334cfdf2caca7752e43d2a50eb"
server_key_version: "encryptionkey@0"
I20260805 23:01:22.711320 2071 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:01:22.715814 2087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:22.717599 2071 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:01:22.717824 2071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "8e11f64983bb46f7897faa3352c3e2c7"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "b0cbb4771b2eaf9e9c9bbe3a20645d12"
server_key_iv: "66884d334cfdf2caca7752e43d2a50eb"
server_key_version: "encryptionkey@0"
I20260805 23:01:22.718083 2071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:22.756453 2071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:22.761300 2071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:22.761626 2071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:22.762748 2071 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:22.764290 2071 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:22.764387 2071 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:22.764515 2071 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:22.764571 2071 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:22.798609 2071 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:34337
I20260805 23:01:22.798691 2246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:34337 every 8 connection(s)
I20260805 23:01:22.800222 2071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:22.808532 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 2071
I20260805 23:01:22.808730 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:01:22.809178 22709 external_mini_cluster.cc:1428] Setting key 9ae19e5d310485b4b6b194100a4e7738
Aug 05 23:01:22 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970882, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:22.825448 2251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:22.803904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:50231)
0805 23:01:22.804680 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:22.804742 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:22.806558 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:22.807538 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:22.807548 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:22.808152 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:22.808865 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:22.808888 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.810103 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.810109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:22.811812 (+ 1703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:22.811833 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.812749 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.812756 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:22.813073 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:22.813873 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:22.813906 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:22.817084 (+ 3178us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:22.820630 (+ 3546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:22.820643 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:22.820665 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:22.821389 (+ 724us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:22.821898 (+ 509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:22.821903 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:22.821907 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:22.822203 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:22.822895 (+ 692us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:22.822904 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:22.823397 (+ 493us) client_negotiation.cc:769] Sending connection context
0805 23:01:22.823728 (+ 331us) client_negotiation.cc:240] Negotiation successful
0805 23:01:22.824262 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":307,"threads_started":1}
I20260805 23:01:22.826656 2249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:22.803331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:50231 (local address 127.22.45.126:45961)
0805 23:01:22.803790 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:22.803795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:22.804890 (+ 1095us) server_negotiation.cc:407] Connection header received
0805 23:01:22.807003 (+ 2113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:22.807009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:22.807110 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:22.807222 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:22.809070 (+ 1848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.809908 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.812001 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:22.812484 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:22.812609 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:22.817468 (+ 4859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:22.817474 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:22.817478 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:22.817521 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:22.820384 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:22.821567 (+ 1183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:22.821575 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:22.821578 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:22.821762 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:22.822378 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:22.822384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:22.822388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:22.822751 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:22.822940 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:22.825954 (+ 3014us) server_negotiation.cc:299] Negotiation successful
0805 23:01:22.826281 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":351,"thread_start_us":240,"threads_started":1}
I20260805 23:01:22.828550 2247 heartbeater.cc:347] Connected to a master server at 127.22.45.126:45961
I20260805 23:01:22.828933 2247 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:22.829821 2247 heartbeater.cc:511] Master 127.22.45.126:45961 requested a full tablet report, sending...
I20260805 23:01:22.831766 1800 ts_manager.cc:194] Registered new tserver with Master: 8e11f64983bb46f7897faa3352c3e2c7 (127.22.45.66:34337)
I20260805 23:01:22.832985 1800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:50231
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:01:22.876165 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:45961
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:23.242322 2254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:23.242669 2254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:23.242794 2254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:23.250406 2254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:23.250568 2254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:23.250721 2254 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:23.254850 2064 heartbeater.cc:503] Master 127.22.45.126:45961 was elected leader, sending a full tablet report...
I20260805 23:01:23.261546 2254 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:45961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:23.263085 2254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:23.264628 2254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:23.279321 2262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:23.279356 2260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:23.279392 2259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:23.280401 2254 server_base.cc:1034] running on GCE node
I20260805 23:01:23.281174 2254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:23.282333 2254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:23.283556 2254 hybrid_clock.cc:648] HybridClock initialized: now 1785970883283496 us; error 62 us; skew 500 ppm
I20260805 23:01:23.283908 2254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:23 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970883, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:23.287449 2254 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:01:23.289244 2254 webserver.cc:460] Webserver started at http://127.22.45.67:41237/ using document root <none> and password file <none>
I20260805 23:01:23.290056 2254 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:23.290197 2254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:23.290539 2254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:23.294044 2254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "57e410a49b7a4908b3645ab751b75754"
format_stamp: "Formatted at 2026-08-05 23:01:23 on dist-test-slave-1vmg"
server_key: "3566707278f89c3d43ed354d6f7720b4"
server_key_iv: "e668038ce12eaf030311ad9002d391d5"
server_key_version: "encryptionkey@0"
I20260805 23:01:23.295101 2254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "57e410a49b7a4908b3645ab751b75754"
format_stamp: "Formatted at 2026-08-05 23:01:23 on dist-test-slave-1vmg"
server_key: "3566707278f89c3d43ed354d6f7720b4"
server_key_iv: "e668038ce12eaf030311ad9002d391d5"
server_key_version: "encryptionkey@0"
I20260805 23:01:23.301606 2254 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:01:23.305984 2271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:23.307729 2254 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260805 23:01:23.307945 2254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "57e410a49b7a4908b3645ab751b75754"
format_stamp: "Formatted at 2026-08-05 23:01:23 on dist-test-slave-1vmg"
server_key: "3566707278f89c3d43ed354d6f7720b4"
server_key_iv: "e668038ce12eaf030311ad9002d391d5"
server_key_version: "encryptionkey@0"
I20260805 23:01:23.308190 2254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:23.335613 2254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:23.340608 2254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:23.340943 2254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:23.342120 2254 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:23.343849 2254 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:23.343951 2254 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:23.344090 2254 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:23.344151 2254 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:23.376892 2254 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:45033
I20260805 23:01:23.376940 2430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:45033 every 8 connection(s)
I20260805 23:01:23.378384 2254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:23.385926 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 2254
I20260805 23:01:23.386116 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:01:23.386608 22709 external_mini_cluster.cc:1428] Setting key 1f4c5a5852d2b61769c71f67455d0a9e
Aug 05 23:01:23 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970883, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:23.401046 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:23.381296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:36237 (local address 127.22.45.126:45961)
0805 23:01:23.381738 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:23.381743 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:23.382803 (+ 1060us) server_negotiation.cc:407] Connection header received
0805 23:01:23.384907 (+ 2104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:23.384913 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:23.385020 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:23.385124 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:23.387153 (+ 2029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.388124 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.389973 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.390387 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.390501 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:23.394465 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:23.394471 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:23.394474 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:23.394515 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:23.397264 (+ 2749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.398209 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.398215 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.398217 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.398366 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.398863 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.398867 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.398869 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.399249 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:23.399413 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:23.400334 (+ 921us) server_negotiation.cc:299] Negotiation successful
0805 23:01:23.400616 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":217,"threads_started":1}
I20260805 23:01:23.402141 2435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:23.381789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:36237)
0805 23:01:23.382609 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:23.382653 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:23.384547 (+ 1894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:23.385432 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:23.385442 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:23.386131 (+ 689us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:23.386892 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:23.386952 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.388296 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.388300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:23.389807 (+ 1507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:23.389825 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.390636 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.390645 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:23.390891 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:23.391632 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:23.391658 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:23.394152 (+ 2494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:23.397465 (+ 3313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:23.397477 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:23.397495 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:23.398037 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:23.398491 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:23.398497 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:23.398501 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:23.398730 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:23.399403 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:23.399413 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:23.399847 (+ 434us) client_negotiation.cc:769] Sending connection context
0805 23:01:23.400179 (+ 332us) client_negotiation.cc:240] Negotiation successful
0805 23:01:23.400851 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":319,"threads_started":1}
I20260805 23:01:23.403740 2431 heartbeater.cc:347] Connected to a master server at 127.22.45.126:45961
I20260805 23:01:23.404068 2431 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:23.404861 2431 heartbeater.cc:511] Master 127.22.45.126:45961 requested a full tablet report, sending...
I20260805 23:01:23.406469 1800 ts_manager.cc:194] Registered new tserver with Master: 57e410a49b7a4908b3645ab751b75754 (127.22.45.67:45033)
I20260805 23:01:23.407408 1800 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:36237
I20260805 23:01:23.415302 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab.
Entry for principal oryx/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab.
WARNING: no policy specified for oryx/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab.
Entry for principal oryx/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab.
WARNING: no policy specified for oryx/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab.
Entry for principal oryx/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab.
I20260805 23:01:23.590975 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 1888
Aug 05 23:01:23 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:01:23.609961 2444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:23.592314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54980 (local address 127.22.45.65:35499)
0805 23:01:23.593193 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:23.593201 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:23.593230 (+ 29us) server_negotiation.cc:407] Connection header received
0805 23:01:23.593295 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:23.593304 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:23.593530 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:23.593682 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:23.595283 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.596476 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.598147 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.598798 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.598973 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:23.603883 (+ 4910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:23.603903 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:23.603922 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:23.603979 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:23.607137 (+ 3158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.608015 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.608023 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.608026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.608181 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.608536 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.608540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.608542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.608941 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:23.609183 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:23.609417 (+ 234us) server_negotiation.cc:299] Negotiation successful
0805 23:01:23.609653 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":710,"thread_start_us":543,"threads_started":1}
I20260805 23:01:23.611455 2057 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:23.695681 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 1888
I20260805 23:01:23.715736 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2071
Aug 05 23:01:23 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:01:23.736510 2446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:23.716651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60480 (local address 127.22.45.66:34337)
0805 23:01:23.717247 (+ 596us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:23.717255 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:23.717283 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:01:23.717347 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:23.717354 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:23.717582 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:23.717736 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:23.719136 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.720262 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.721769 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.722463 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.722593 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:23.728400 (+ 5807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:23.728426 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:23.728448 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:23.728537 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:23.732462 (+ 3925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.733554 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.733564 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.733567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.733791 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.734216 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.734220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.734222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.734696 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:23.735064 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:23.735842 (+ 778us) server_negotiation.cc:299] Negotiation successful
0805 23:01:23.736128 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":289,"threads_started":1}
I20260805 23:01:23.738122 2240 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:23.822969 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 2071
I20260805 23:01:23.843075 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2254
Aug 05 23:01:23 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:01:23.861250 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:23.844127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55264 (local address 127.22.45.67:45033)
0805 23:01:23.844651 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:23.844658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:23.844703 (+ 45us) server_negotiation.cc:407] Connection header received
0805 23:01:23.844776 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:23.844782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:23.845005 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:23.845158 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:23.846563 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.847846 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.849259 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:23.849871 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:23.849986 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:23.855191 (+ 5205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:23.855212 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:23.855232 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:23.855284 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:23.858291 (+ 3007us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.859175 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.859184 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.859186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.859345 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:23.859669 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:23.859672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:23.859674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:23.860077 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:23.860321 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:23.860660 (+ 339us) server_negotiation.cc:299] Negotiation successful
0805 23:01:23.860909 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":239,"threads_started":1}
I20260805 23:01:23.862699 2424 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:23.946623 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 2254
I20260805 23:01:23.966121 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 1757
I20260805 23:01:23.967497 1842 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:24.073159 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 1757
I20260805 23:01:24.100930 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45961
--webserver_interface=127.22.45.126
--webserver_port=32863
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:45961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:24.453572 2451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:24.453951 2451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:24.454083 2451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:24.461920 2451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:24.462096 2451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:24.462177 2451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:24.462260 2451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:24.462322 2451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:24.473163 2451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:45961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:45961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=32863
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:24.474702 2451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:24.476169 2451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:24.489533 2457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:24.489624 2458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:24.489745 2464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:24.491226 2451 server_base.cc:1034] running on GCE node
I20260805 23:01:24.492268 2451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:24.494050 2451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:24.495340 2451 hybrid_clock.cc:648] HybridClock initialized: now 1785970884495278 us; error 68 us; skew 500 ppm
I20260805 23:01:24.495771 2451 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:24 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970884, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:24.503033 2451 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:01:24.505043 2451 webserver.cc:460] Webserver started at http://127.22.45.126:32863/ using document root <none> and password file <none>
I20260805 23:01:24.505893 2451 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:24.506062 2451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:24.512931 2451 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260805 23:01:24.516381 2474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:24.518168 2451 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:01:24.518416 2451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "6e42b3b2d7cf499197045f4004da46dc"
format_stamp: "Formatted at 2026-08-05 23:01:21 on dist-test-slave-1vmg"
server_key: "fb8d1bf3c6a4b36b4b2a709ff3e7ad7b"
server_key_iv: "571f19cced593beac639623bc8896b38"
server_key_version: "encryptionkey@0"
I20260805 23:01:24.519642 2451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:24.531828 2451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:24.536448 2451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:24.536737 2451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:24.556556 2451 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:45961
I20260805 23:01:24.556581 2546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:45961 every 8 connection(s)
I20260805 23:01:24.558351 2451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:01:24.558871 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 2451
I20260805 23:01:24.559955 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:35499
--local_ip_for_outbound_sockets=127.22.45.65
--tserver_master_addrs=127.22.45.126:45961
--webserver_port=34585
--webserver_interface=127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:01:24.566560 2547 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:01:24.570370 2547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Bootstrap starting.
I20260805 23:01:24.590677 2547 log.cc:824] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:24.600121 2547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:01:24.600693 2547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Bootstrap complete.
I20260805 23:01:24.610365 2547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:24.611392 2547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e42b3b2d7cf499197045f4004da46dc, State: Initialized, Role: FOLLOWER
I20260805 23:01:24.612037 2547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:24.612298 2547 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:01:24.612416 2547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:01:24.612586 2547 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 1 FOLLOWER]: Advancing to term 2
I20260805 23:01:24.617050 2547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:24.617679 2547 leader_election.cc:302] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e42b3b2d7cf499197045f4004da46dc; no voters:
I20260805 23:01:24.618366 2547 leader_election.cc:288] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 23:01:24.618536 2552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 2 FOLLOWER]: Leader election won for term 2
I20260805 23:01:24.619956 2552 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [term 2 LEADER]: Becoming Leader. State: Replica: 6e42b3b2d7cf499197045f4004da46dc, State: Running, Role: LEADER
I20260805 23:01:24.620645 2552 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } }
I20260805 23:01:24.620862 2547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:24.623731 2553 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6e42b3b2d7cf499197045f4004da46dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } } }
I20260805 23:01:24.624259 2553 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:24.625074 2554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e42b3b2d7cf499197045f4004da46dc. Latest consensus state: current_term: 2 leader_uuid: "6e42b3b2d7cf499197045f4004da46dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e42b3b2d7cf499197045f4004da46dc" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 45961 } } }
I20260805 23:01:24.625468 2554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:24.635387 2566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:24.642944 2566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:24.644888 2566 catalog_manager.cc:1259] Loaded cluster ID: 8078ac7402964183970d5ddb8548da2a
I20260805 23:01:24.645136 2566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:24.649669 2566 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:24.651955 2566 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6e42b3b2d7cf499197045f4004da46dc: Loaded TSK: 0
I20260805 23:01:24.653972 2566 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 23:01:24.936614 2549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:24.936954 2549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:24.937114 2549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:24.944901 2549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:24.945075 2549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:24.945245 2549 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:24.956041 2549 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.65.keytab
--principal=oryx/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:35499
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=34585
--tserver_master_addrs=127.22.45.126:45961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:24.957607 2549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:24.959122 2549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:24.980731 2586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:24.980764 2589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:24.983333 2549 server_base.cc:1034] running on GCE node
W20260805 23:01:24.984249 2593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:24.985051 2549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:24.986164 2549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:24.987396 2549 hybrid_clock.cc:648] HybridClock initialized: now 1785970884987327 us; error 70 us; skew 500 ppm
I20260805 23:01:24.987747 2549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:24 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970884, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:24.991490 2549 init.cc:377] Logged in from keytab as oryx/127.22.45.65@KRBTEST.COM (short username oryx)
I20260805 23:01:24.993386 2549 webserver.cc:460] Webserver started at http://127.22.45.65:34585/ using document root <none> and password file <none>
I20260805 23:01:24.994201 2549 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:24.994359 2549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:25.000891 2549 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:01:25.004351 2601 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:25.006114 2549 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:01:25.006317 2549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "89a55efaeb7e419fac777a59b06b4947"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "cc3378269a0b0b833aeadf1d64309a16"
server_key_iv: "3bfa9d57d0145f6c0a6676eba27e9bde"
server_key_version: "encryptionkey@0"
I20260805 23:01:25.007452 2549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:25.021697 2549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:25.026530 2549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:25.026839 2549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:25.028010 2549 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:25.029621 2549 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:25.029734 2549 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:25.029858 2549 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:25.029932 2549 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:25.062117 2549 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:35499
I20260805 23:01:25.062178 2765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:35499 every 8 connection(s)
I20260805 23:01:25.063913 2549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:25.073344 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 2549
I20260805 23:01:25.074054 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:34337
--local_ip_for_outbound_sockets=127.22.45.66
--tserver_master_addrs=127.22.45.126:45961
--webserver_port=43457
--webserver_interface=127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:01:25 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:25 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 23:01:25.431934 2771 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:25.432281 2771 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:25.432403 2771 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:25.440264 2771 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:25.440413 2771 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:25.440574 2771 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:25.451025 2771 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.66.keytab
--principal=oryx/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:34337
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=43457
--tserver_master_addrs=127.22.45.126:45961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:25.452543 2771 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:25.453946 2771 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:25.471957 2783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:25.472519 2780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:25.472635 2786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:25.473188 2771 server_base.cc:1034] running on GCE node
I20260805 23:01:25.474291 2771 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:25.476054 2771 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:25.477391 2771 hybrid_clock.cc:648] HybridClock initialized: now 1785970885477328 us; error 49 us; skew 500 ppm
I20260805 23:01:25.477950 2771 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:25 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970885, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:25.483734 2771 init.cc:377] Logged in from keytab as oryx/127.22.45.66@KRBTEST.COM (short username oryx)
I20260805 23:01:25.486646 2771 webserver.cc:460] Webserver started at http://127.22.45.66:43457/ using document root <none> and password file <none>
I20260805 23:01:25.488071 2771 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:25.488325 2771 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:25.498811 2771 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.000s
I20260805 23:01:25.504283 2798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:25.506997 2771 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260805 23:01:25.507228 2771 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "8e11f64983bb46f7897faa3352c3e2c7"
format_stamp: "Formatted at 2026-08-05 23:01:22 on dist-test-slave-1vmg"
server_key: "b0cbb4771b2eaf9e9c9bbe3a20645d12"
server_key_iv: "66884d334cfdf2caca7752e43d2a50eb"
server_key_version: "encryptionkey@0"
I20260805 23:01:25.508352 2771 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:25.542416 2771 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:25.547609 2771 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:25.547919 2771 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:25.549065 2771 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:25.550740 2771 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:25.550937 2771 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:25.551086 2771 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:25.551174 2771 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:25.597940 2771 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:34337
I20260805 23:01:25.598071 2960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:34337 every 8 connection(s)
I20260805 23:01:25.599638 2771 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:25.605448 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 2771
I20260805 23:01:25.606406 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:45033
--local_ip_for_outbound_sockets=127.22.45.67
--tserver_master_addrs=127.22.45.126:45961
--webserver_port=41237
--webserver_interface=127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:01:25 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:25 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
W20260805 23:01:26.189404 2969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:26.189889 2969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:26.190089 2969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:26.202055 2969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:26.202291 2969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:26.202517 2969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:26.216976 2969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/krb5kdc/oryx_127.22.45.67.keytab
--principal=oryx/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:45033
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=41237
--tserver_master_addrs=127.22.45.126:45961
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:26.218834 2969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:26.220724 2969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:26.241433 2983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:26.242278 2982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:26.243199 2987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:26.243762 2969 server_base.cc:1034] running on GCE node
I20260805 23:01:26.244563 2969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:26.245895 2969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:26.247154 2969 hybrid_clock.cc:648] HybridClock initialized: now 1785970886247066 us; error 76 us; skew 500 ppm
I20260805 23:01:26.247615 2969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970886, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:26.252153 2969 init.cc:377] Logged in from keytab as oryx/127.22.45.67@KRBTEST.COM (short username oryx)
I20260805 23:01:26.254817 2969 webserver.cc:460] Webserver started at http://127.22.45.67:41237/ using document root <none> and password file <none>
I20260805 23:01:26.256143 2969 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:26.256371 2969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:26.266649 2969 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.006s sys 0.000s
I20260805 23:01:26.271826 2998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:26.274302 2969 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:01:26.274590 2969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "57e410a49b7a4908b3645ab751b75754"
format_stamp: "Formatted at 2026-08-05 23:01:23 on dist-test-slave-1vmg"
server_key: "3566707278f89c3d43ed354d6f7720b4"
server_key_iv: "e668038ce12eaf030311ad9002d391d5"
server_key_version: "encryptionkey@0"
I20260805 23:01:26.276448 2969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260805 23:01:26.286440 2770 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.207s user 0.000s sys 0.014s
I20260805 23:01:26.288551 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:25.067413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:32979)
0805 23:01:25.068341 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:25.068403 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:25.070347 (+ 1944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:25.072037 (+ 1690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:25.072046 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:25.072664 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:25.073344 (+ 680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:25.073366 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.075346 (+ 1980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.075350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:25.076735 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:25.076752 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.078012 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.078022 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:25.078304 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:25.079152 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:25.079185 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:26.287318 (+1208133us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":407,"threads_started":1}
W20260805 23:01:26.288556 2769 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:25.067324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:32979 (local address 127.22.45.126:45961)
0805 23:01:25.068070 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:25.068083 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:25.068546 (+ 463us) server_negotiation.cc:407] Connection header received
0805 23:01:25.071024 (+ 2478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:25.071042 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:25.071490 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:25.071849 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:25.073619 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.075105 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.076935 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.077684 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.077906 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.287794 (+1209888us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:32979: BlockingRecv error: recv got EOF from 127.22.45.65:32979 (error 108)
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":285,"threads_started":1}
W20260805 23:01:26.290215 2766 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:45961 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.45.126:45961: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
I20260805 23:01:26.300966 2969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:26.305508 2770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:26.291280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:40747)
0805 23:01:26.291755 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:26.291780 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:26.291938 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:26.293062 (+ 1124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:26.293068 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:26.293660 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:26.293928 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.293941 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.295802 (+ 1861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.295809 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.297318 (+ 1509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.297338 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.298376 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.298385 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.298610 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.299340 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:26.299369 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:26.305100 (+ 5731us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317}
W20260805 23:01:26.305670 2769 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:26.292254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:40747 (local address 127.22.45.126:45961)
0805 23:01:26.292468 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:26.292475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:26.292498 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:01:26.292576 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:26.292582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:26.292671 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:26.292779 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:26.294189 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.295565 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.297505 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.298104 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.298256 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.305420 (+ 7164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:40747: BlockingRecv error: recv got EOF from 127.22.45.65:40747 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 23:01:26.306022 2969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:26.306316 2969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:26.307585 2969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:26.309590 2969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:26.309725 2969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:26.309851 2969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:26.309926 2969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:26.321973 3004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:26.306834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:48233)
0805 23:01:26.308012 (+ 1178us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:26.308034 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:26.308193 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:26.308709 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:26.308716 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:26.309513 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:26.309920 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.309936 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.311715 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.311721 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.313732 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.313760 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.314988 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.314997 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.315232 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.316073 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:26.316102 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:26.321565 (+ 5463us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1032,"thread_start_us":325,"threads_started":1}
W20260805 23:01:26.322185 2769 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:26.307249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:48233 (local address 127.22.45.126:45961)
0805 23:01:26.308029 (+ 780us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:26.308037 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:26.308327 (+ 290us) server_negotiation.cc:407] Connection header received
0805 23:01:26.308409 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:26.308414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:26.308514 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:26.308627 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:26.310129 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.311448 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.313975 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.314682 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.314851 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.321916 (+ 7065us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:48233: BlockingRecv error: recv got EOF from 127.22.45.65:48233 (error 108)
Metrics: {"server-negotiator.queue_time_us":613}
W20260805 23:01:26.322746 2766 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 23:01:26.355404 2969 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:45033
I20260805 23:01:26.355446 3159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:45033 every 8 connection(s)
I20260805 23:01:26.357196 2969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:26.361115 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 2969
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:26.400748 3165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:26.363087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49140 (local address 127.22.45.126:45961)
0805 23:01:26.363661 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:26.363667 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:26.374374 (+ 10707us) server_negotiation.cc:407] Connection header received
0805 23:01:26.375070 (+ 696us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:26.375079 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:26.375202 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:26.375353 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:26.377585 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.379147 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.381221 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.382043 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.382272 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.389387 (+ 7115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:26.389404 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:26.389438 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:26.389527 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:26.394783 (+ 5256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:26.396259 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:26.396273 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:26.396286 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:26.396694 (+ 408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:26.397269 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:26.397275 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:26.397279 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:26.398238 (+ 959us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:26.398756 (+ 518us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:26.399522 (+ 766us) server_negotiation.cc:299] Negotiation successful
0805 23:01:26.400166 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":294,"threads_started":1}
W20260805 23:01:26.690338 2968 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.076s user 0.011s sys 0.003s
W20260805 23:01:26.692081 2965 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:25.603292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:50723 (local address 127.22.45.126:45961)
0805 23:01:25.603935 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:25.603944 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:25.605427 (+ 1483us) server_negotiation.cc:407] Connection header received
0805 23:01:25.607308 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:25.607314 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:25.607422 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:25.607528 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:25.609283 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.610104 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.612541 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.613177 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.613320 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.691655 (+1078335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:50723: BlockingRecv error: recv got EOF from 127.22.45.66:50723 (error 108)
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":282,"threads_started":1}
I20260805 23:01:26.692281 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:25.603954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:50723)
0805 23:01:25.604859 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:25.604912 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:25.606980 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:25.607834 (+ 854us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:25.607843 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:25.608434 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:25.609064 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:25.609085 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.610289 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.610294 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:25.612339 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:25.612359 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:25.613515 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:25.613525 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:25.613793 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:25.614640 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:25.614666 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:26.691297 (+1076631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":360,"threads_started":1}
W20260805 23:01:26.693331 2962 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:45961 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.45.126:45961: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:26.704006 2968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:26.694131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:40809)
0805 23:01:26.694352 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:26.694372 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:26.694476 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:26.694838 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:26.694841 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:26.695262 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:26.695434 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.695442 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.697101 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.697106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.698098 (+ 992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.698110 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.699148 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.699152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.699273 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.699896 (+ 623us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:26.699913 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:26.703781 (+ 3868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":78}
W20260805 23:01:26.704355 2965 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:26.694253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:40809 (local address 127.22.45.126:45961)
0805 23:01:26.694494 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:26.694501 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:26.694527 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:01:26.694604 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:26.694610 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:26.694700 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:26.694824 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:26.695577 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.696910 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.698239 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.698980 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.699111 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.704072 (+ 4961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:40809: BlockingRecv error: recv got EOF from 127.22.45.66:40809 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:26 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:26.714870 3168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:26.704704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:38567)
0805 23:01:26.705273 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:26.705293 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:26.705397 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:26.705783 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:26.705786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:26.706232 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:26.706458 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.706467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.708130 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.708134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.709096 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.709108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.710102 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.710106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.710238 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.710899 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:26.710948 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:26.714618 (+ 3670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":337,"threads_started":1}
W20260805 23:01:26.715243 2962 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 23:01:26.715418 2965 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:26.705291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:38567 (local address 127.22.45.126:45961)
0805 23:01:26.705476 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:26.705482 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:26.705503 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:01:26.705563 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:26.705569 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:26.705663 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:26.705777 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:26.706583 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.707969 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.709233 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.709938 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.710068 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.715036 (+ 4968us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:38567: BlockingRecv error: recv got EOF from 127.22.45.66:38567 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:27.338740 3169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:27.323482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:33321)
0805 23:01:27.325055 (+ 1573us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:27.325078 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:27.325234 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:27.325782 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:27.325787 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:27.326334 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:27.326567 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.326580 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.328864 (+ 2284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.328871 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.330428 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.330453 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.331907 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.331920 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.332195 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.333684 (+ 1489us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:27.333719 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:27.338478 (+ 4759us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1440,"thread_start_us":1304,"threads_started":1}
W20260805 23:01:27.339159 3171 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:27.323511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:33321 (local address 127.22.45.126:45961)
0805 23:01:27.324889 (+ 1378us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:27.324895 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:27.325174 (+ 279us) server_negotiation.cc:407] Connection header received
0805 23:01:27.325392 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:27.325398 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:27.325489 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:27.325614 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:27.326799 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.328620 (+ 1821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.330698 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.331481 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.331655 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.338838 (+ 7183us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:33321: BlockingRecv error: recv got EOF from 127.22.45.65:33321 (error 108)
Metrics: {"server-negotiator.queue_time_us":1234,"thread_start_us":1023,"threads_started":1}
W20260805 23:01:27.399014 3163 sasl_common.cc:323] Time spent calling sasl_client_start(): real 1.027s user 0.004s sys 0.012s
W20260805 23:01:27.400363 2769 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:26.360311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:42835 (local address 127.22.45.126:45961)
0805 23:01:26.360580 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:26.360589 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:26.362667 (+ 2078us) server_negotiation.cc:407] Connection header received
0805 23:01:26.365006 (+ 2339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:26.365012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:26.365108 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:26.365203 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:26.367624 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.368361 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.370134 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.370601 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.370733 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.400078 (+1029345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:42835: BlockingRecv error: recv got EOF from 127.22.45.67:42835 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 23:01:27.401144 3163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:26.360941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:42835)
0805 23:01:26.362466 (+ 1525us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:26.362524 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:26.364645 (+ 2121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:26.365539 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:26.365553 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:26.366384 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:26.367310 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.367339 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.368561 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.368566 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.369936 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:26.369952 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:26.370905 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:26.370951 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:26.371197 (+ 246us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:26.371946 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:26.371979 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:27.399877 (+1027898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1182,"thread_start_us":930,"threads_started":1}
W20260805 23:01:27.402189 3160 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:45961 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.45.126:45961: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:27.411934 3163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:27.402891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:43737)
0805 23:01:27.403133 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:27.403157 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:27.403283 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:27.403580 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:27.403583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:27.403970 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:27.404171 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.404181 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.405218 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.405223 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.406231 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.406245 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.407096 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.407102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.407235 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.407894 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:27.407914 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:27.411633 (+ 3719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260805 23:01:27.412181 2769 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:27.403083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:43737 (local address 127.22.45.126:45961)
0805 23:01:27.403329 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:27.403334 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:27.403350 (+ 16us) server_negotiation.cc:407] Connection header received
0805 23:01:27.403397 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:27.403401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:27.403461 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:27.403543 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:27.404295 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.405080 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.406381 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.406842 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.407011 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.411925 (+ 4914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:43737: BlockingRecv error: recv got EOF from 127.22.45.67:43737 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:27.421288 3163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:27.412758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:42823)
0805 23:01:27.412909 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:27.412928 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:27.413025 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:27.413404 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:27.413407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:27.413826 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:27.414012 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.414022 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.415135 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.415140 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.416105 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.416117 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.416766 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.416770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.416910 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.417522 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:27.417540 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:27.421061 (+ 3521us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260805 23:01:27.421501 2769 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:27.412866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:42823 (local address 127.22.45.126:45961)
0805 23:01:27.413022 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:27.413028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:27.413047 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:01:27.413136 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:27.413141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:27.413253 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:27.413366 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:27.414150 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.414987 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.416214 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.416602 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.416691 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.421291 (+ 4600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:42823: BlockingRecv error: recv got EOF from 127.22.45.67:42823 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260805 23:01:27.421821 3160 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:27 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:27.725226 3174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:27.715902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:46597)
0805 23:01:27.716408 (+ 506us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:27.716426 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:27.716550 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:27.716856 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:27.716859 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:27.717271 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:27.717437 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.717446 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.718472 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.718475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.719515 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:27.719531 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.720263 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.720267 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:27.720394 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.721066 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:27.721084 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:27.724899 (+ 3815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":299,"threads_started":1}
W20260805 23:01:27.725469 2769 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:27.715977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:46597 (local address 127.22.45.126:45961)
0805 23:01:27.716195 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:27.716202 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:27.716508 (+ 306us) server_negotiation.cc:407] Connection header received
0805 23:01:27.716637 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:27.716641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:27.716740 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:27.716824 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:27.717563 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.718342 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.719646 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:27.720117 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:27.720222 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:27.725204 (+ 4982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:46597: BlockingRecv error: recv got EOF from 127.22.45.66:46597 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 05 23:01:28 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:28 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:28.349890 3175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:28.339988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:33235)
0805 23:01:28.340539 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:28.340560 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:28.340712 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:28.341023 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:28.341027 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:28.341440 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:28.341633 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:28.341644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.342794 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.342800 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:28.343868 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:28.343885 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.344666 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.344670 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:28.344825 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:28.345504 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:28.345525 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:28.349626 (+ 4101us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":271,"threads_started":1}
W20260805 23:01:28.350109 3176 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:28.340109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:33235 (local address 127.22.45.126:45961)
0805 23:01:28.340645 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:28.340649 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:28.340669 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:01:28.340824 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:28.340828 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:28.340891 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:28.340987 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:28.341786 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.342594 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.344059 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.344510 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.344643 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:28.349871 (+ 5228us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:33235: BlockingRecv error: recv got EOF from 127.22.45.65:33235 (error 108)
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":302,"threads_started":1}
Aug 05 23:01:28 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:28 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:28.432235 3177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:28.422465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:36259)
0805 23:01:28.423164 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:28.423184 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:28.423326 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:28.423694 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:28.423700 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:28.424243 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:28.424408 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:28.424418 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.425572 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.425578 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:28.426554 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:28.426567 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.427405 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.427414 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:28.427585 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:28.428255 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:28.428275 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:28.431882 (+ 3607us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":417,"threads_started":1}
W20260805 23:01:28.432396 3176 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:28.422544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:36259 (local address 127.22.45.126:45961)
0805 23:01:28.422738 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:28.422744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:28.423274 (+ 530us) server_negotiation.cc:407] Connection header received
0805 23:01:28.423467 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:28.423473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:28.423545 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:28.423630 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:28.424570 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.425413 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.426718 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.427202 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.427324 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:28.432178 (+ 4854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:36259: BlockingRecv error: recv got EOF from 127.22.45.67:36259 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 05 23:01:28 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:28 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:28.735991 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:28.726531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:53917)
0805 23:01:28.727083 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:28.727101 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:28.727222 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:28.727538 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:28.727542 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:28.727962 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:28.728157 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:28.728166 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.729226 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.729231 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:28.730206 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:28.730220 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.731031 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.731036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:28.731176 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:28.731877 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:28.731897 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:28.735726 (+ 3829us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":274,"threads_started":1}
W20260805 23:01:28.736253 3176 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:28.726591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:53917 (local address 127.22.45.126:45961)
0805 23:01:28.726772 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:28.726776 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:28.727179 (+ 403us) server_negotiation.cc:407] Connection header received
0805 23:01:28.727322 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:28.727325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:28.727406 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:28.727484 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:28.728307 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.729065 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.730372 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:28.730814 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:28.730939 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:28.736002 (+ 5063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:53917: BlockingRecv error: recv got EOF from 127.22.45.66:53917 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 05 23:01:29 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:29 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:29.361382 3180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:29.351109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:47361)
0805 23:01:29.351628 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:29.351645 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:29.351763 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:29.352277 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:29.352280 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:29.352688 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:29.352874 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:29.352883 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.353954 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.353958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:29.355131 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:29.355150 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.355966 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.355972 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:29.356170 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:29.356889 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:29.356915 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:29.361029 (+ 4114us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":281,"threads_started":1}
W20260805 23:01:29.361586 3181 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:29.351283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:47361 (local address 127.22.45.126:45961)
0805 23:01:29.351967 (+ 684us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:29.351971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:29.351988 (+ 17us) server_negotiation.cc:407] Connection header received
0805 23:01:29.352041 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:29.352045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:29.352117 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:29.352235 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:29.353011 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.353797 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.355330 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.355790 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.355895 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:29.361316 (+ 5421us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:47361: BlockingRecv error: recv got EOF from 127.22.45.65:47361 (error 108)
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":456,"threads_started":1}
Aug 05 23:01:29 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:29 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:29.443195 3182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:29.433533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:54481)
0805 23:01:29.434117 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:29.434136 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:29.434314 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:29.434759 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:29.434765 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:29.435271 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:29.435513 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:29.435525 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.436659 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.436665 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:29.437626 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:29.437641 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.438406 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.438411 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:29.438582 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:29.439251 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:29.439270 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:29.442791 (+ 3521us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":303,"threads_started":1}
W20260805 23:01:29.443481 3181 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:29.433701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:54481 (local address 127.22.45.126:45961)
0805 23:01:29.434005 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:29.434012 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:29.434231 (+ 219us) server_negotiation.cc:407] Connection header received
0805 23:01:29.434486 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:29.434490 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:29.434558 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:29.434659 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:29.435670 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.436474 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.437811 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.438237 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.438353 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:29.443088 (+ 4735us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:54481: BlockingRecv error: recv got EOF from 127.22.45.67:54481 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Aug 05 23:01:29 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:29 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:29.751313 3183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:29.737048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:42129)
0805 23:01:29.737617 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:29.737635 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:29.737767 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:29.738109 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:29.738113 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:29.738542 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:29.738708 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:29.738717 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.739818 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.739824 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:29.740748 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:29.740760 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.741489 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.741494 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:29.741669 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:29.747035 (+ 5366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:29.747056 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:29.751041 (+ 3985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":361,"threads_started":1}
W20260805 23:01:29.751410 3181 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:29.737074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:42129 (local address 127.22.45.126:45961)
0805 23:01:29.737246 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:29.737251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:29.737728 (+ 477us) server_negotiation.cc:407] Connection header received
0805 23:01:29.737880 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:29.737886 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:29.737971 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:29.738056 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:29.738853 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.739664 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.740886 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:29.741344 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:29.741457 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:29.751200 (+ 9743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:42129: BlockingRecv error: recv got EOF from 127.22.45.66:42129 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 05 23:01:30 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:30 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:30.371750 3184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:30.362380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:40635)
0805 23:01:30.362903 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:30.362950 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:30.363069 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:30.363524 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:30.363528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:30.363941 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:30.364112 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:30.364121 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.365121 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.365125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:30.366141 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:30.366155 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.366864 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.366869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:30.367061 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:30.367727 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:30.367747 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:30.371397 (+ 3650us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":271,"threads_started":1}
W20260805 23:01:30.371951 3187 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:30.362503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:40635 (local address 127.22.45.126:45961)
0805 23:01:30.363225 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:30.363230 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:30.363246 (+ 16us) server_negotiation.cc:407] Connection header received
0805 23:01:30.363294 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:30.363297 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:30.363366 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:30.363454 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:30.364267 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.365002 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.366266 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.366677 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.366780 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:30.371686 (+ 4906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:40635: BlockingRecv error: recv got EOF from 127.22.45.65:40635 (error 108)
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":499,"threads_started":1}
Aug 05 23:01:30 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:30 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:30.454087 3188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:30.444268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:60389)
0805 23:01:30.444849 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:30.444867 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:30.445027 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:30.445373 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:30.445378 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:30.445817 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:30.445994 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:30.446004 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.447293 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.447297 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:30.448254 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:30.448269 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.448980 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.448986 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:30.449158 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:30.449794 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:30.449814 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:30.453767 (+ 3953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":296,"threads_started":1}
W20260805 23:01:30.454231 3187 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:30.444446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:60389 (local address 127.22.45.126:45961)
0805 23:01:30.444781 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:30.444788 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:30.444961 (+ 173us) server_negotiation.cc:407] Connection header received
0805 23:01:30.445159 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:30.445163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:30.445231 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:30.445322 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:30.446183 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.447145 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.448414 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.448824 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.448943 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:30.454031 (+ 5088us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:60389: BlockingRecv error: recv got EOF from 127.22.45.67:60389 (error 108)
Metrics: {"server-negotiator.queue_time_us":159}
Aug 05 23:01:30 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:30 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:30.762398 3189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:30.752529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:51613)
0805 23:01:30.753081 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:30.753099 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:30.753273 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:30.753630 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:30.753635 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:30.754064 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:30.754244 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:30.754254 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.755415 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.755419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:30.756457 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:30.756469 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.757234 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.757240 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:30.757425 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:30.758097 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:30.758118 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:30.762018 (+ 3900us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":296,"threads_started":1}
W20260805 23:01:30.762537 3187 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:30.752704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:51613 (local address 127.22.45.126:45961)
0805 23:01:30.752952 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:30.752959 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:30.753189 (+ 230us) server_negotiation.cc:407] Connection header received
0805 23:01:30.753405 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:30.753411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:30.753492 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:30.753582 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:30.754404 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.755264 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.756606 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:30.757066 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:30.757185 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:30.762286 (+ 5101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:51613: BlockingRecv error: recv got EOF from 127.22.45.66:51613 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 05 23:01:31 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:31 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:31.383044 3190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:31.372927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:53729)
0805 23:01:31.373519 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:31.373538 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:31.373685 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:31.374016 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:31.374019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:31.374446 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:31.374621 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:31.374631 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.375869 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.375873 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:31.376885 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:31.376900 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.377699 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.377704 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:31.377845 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:31.378528 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:31.378550 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:31.382657 (+ 4107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":326,"threads_started":1}
W20260805 23:01:31.383232 3193 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:31.373063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:53729 (local address 127.22.45.126:45961)
0805 23:01:31.373545 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:31.373550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:31.373662 (+ 112us) server_negotiation.cc:407] Connection header received
0805 23:01:31.373789 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:31.373793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:31.373877 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:31.373985 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:31.374788 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.375688 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.377058 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.377503 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.377619 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:31.382953 (+ 5334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:53729: BlockingRecv error: recv got EOF from 127.22.45.65:53729 (error 108)
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":258,"threads_started":1}
Aug 05 23:01:31 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:31 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:31.464478 3197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:31.455241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:35511)
0805 23:01:31.455998 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:31.456017 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:31.456135 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:31.456485 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:31.456490 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:31.456924 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:31.457104 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:31.457113 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.458080 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.458083 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:31.459101 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:31.459113 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.459916 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.459920 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:31.460048 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:31.460677 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:31.460696 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:31.464196 (+ 3500us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":470,"threads_started":1}
W20260805 23:01:31.464716 3193 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:31.455296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:35511 (local address 127.22.45.126:45961)
0805 23:01:31.455495 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:31.455501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:31.456096 (+ 595us) server_negotiation.cc:407] Connection header received
0805 23:01:31.456235 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:31.456241 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:31.456318 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:31.456401 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:31.457232 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.457969 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.459313 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.459788 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.459907 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:31.464472 (+ 4565us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:35511: BlockingRecv error: recv got EOF from 127.22.45.67:35511 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 05 23:01:31 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:31 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:31.774071 3198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:31.763605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:33931)
0805 23:01:31.764349 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:31.764377 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:31.764809 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:31.765247 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:31.765252 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:31.765758 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:31.765928 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:31.765938 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.767074 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.767079 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:31.768083 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:31.768098 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.768944 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.768950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:31.769132 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:31.769968 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:31.769989 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:31.773823 (+ 3834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":362,"threads_started":1}
W20260805 23:01:31.774454 3193 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:31.764078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:33931 (local address 127.22.45.126:45961)
0805 23:01:31.764360 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:31.764368 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:31.764581 (+ 213us) server_negotiation.cc:407] Connection header received
0805 23:01:31.764987 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:31.764992 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:31.765076 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:31.765171 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:31.766095 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.766883 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.768249 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:31.768750 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:31.768877 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:31.774115 (+ 5238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:33931: BlockingRecv error: recv got EOF from 127.22.45.66:33931 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 05 23:01:32 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:32 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:32.394157 3199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:32.384327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:35735)
0805 23:01:32.384892 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:32.384910 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:32.385028 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:32.385369 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:32.385372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:32.385920 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:32.386115 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:32.386125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.387560 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.387566 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:32.388562 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:32.388575 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.389453 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.389458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:32.389591 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:32.390228 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:32.390248 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:32.393885 (+ 3637us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":315,"threads_started":1}
W20260805 23:01:32.394507 3200 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:32.384420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:35735 (local address 127.22.45.126:45961)
0805 23:01:32.384951 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:32.384956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:32.384975 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:01:32.385131 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:32.385135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:32.385227 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:32.385334 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:32.386272 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.387397 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.388754 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.389285 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.389399 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:32.394207 (+ 4808us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:35735: BlockingRecv error: recv got EOF from 127.22.45.65:35735 (error 108)
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":271,"threads_started":1}
Aug 05 23:01:32 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:32 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:32.475489 3201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:32.465525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:58411)
0805 23:01:32.466158 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:32.466178 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:32.466316 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:32.466679 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:32.466683 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:32.467194 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:32.467361 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:32.467370 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.468443 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.468448 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:32.469407 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:32.469421 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.470130 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.470134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:32.470259 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:32.470974 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:32.471000 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:32.475176 (+ 4176us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":371,"threads_started":1}
W20260805 23:01:32.475791 3200 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:32.465673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:58411 (local address 127.22.45.126:45961)
0805 23:01:32.465882 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:32.465887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:32.466266 (+ 379us) server_negotiation.cc:407] Connection header received
0805 23:01:32.466417 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:32.466421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:32.466491 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:32.466587 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:32.467530 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.468302 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.469567 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.470003 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.470105 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:32.475409 (+ 5304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:58411: BlockingRecv error: recv got EOF from 127.22.45.67:58411 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 05 23:01:32 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:32 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:32.785640 3204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:32.775714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:45937)
0805 23:01:32.776201 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:32.776219 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:32.776348 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:32.776657 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:32.776660 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:32.777119 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:32.777299 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:32.777309 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.778659 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.778665 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:32.779947 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:32.779970 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.780720 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.780725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:32.780857 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:32.781460 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:32.781478 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:32.785310 (+ 3832us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":252,"threads_started":1}
W20260805 23:01:32.785847 3200 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:32.775860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:45937 (local address 127.22.45.126:45961)
0805 23:01:32.776133 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:32.776140 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:32.776302 (+ 162us) server_negotiation.cc:407] Connection header received
0805 23:01:32.776447 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:32.776451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:32.776536 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:32.776625 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:32.777494 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.778489 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.780134 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:32.780562 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:32.780677 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:32.785577 (+ 4900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:45937: BlockingRecv error: recv got EOF from 127.22.45.66:45937 (error 108)
Metrics: {"server-negotiator.queue_time_us":121}
Aug 05 23:01:33 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:33 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:33.405507 3205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:33.395254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:34979)
0805 23:01:33.396122 (+ 868us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:33.396140 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:33.396272 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:33.396597 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:33.396601 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:33.397019 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:33.397219 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:33.397228 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.398291 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.398296 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:33.399329 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:33.399343 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.400151 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.400157 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:33.400302 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:33.401053 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:33.401074 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:33.405217 (+ 4143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":518,"threads_started":1}
W20260805 23:01:33.405694 3207 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:33.395358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:34979 (local address 127.22.45.126:45961)
0805 23:01:33.395881 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:33.395886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:33.396226 (+ 340us) server_negotiation.cc:407] Connection header received
0805 23:01:33.396371 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:33.396375 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:33.396439 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:33.396534 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:33.397370 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.398142 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.399472 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.399945 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.400050 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:33.405456 (+ 5406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:34979: BlockingRecv error: recv got EOF from 127.22.45.65:34979 (error 108)
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":273,"threads_started":1}
Aug 05 23:01:33 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:33 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:33.486951 3209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:33.476825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:37487)
0805 23:01:33.477353 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:33.477374 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:33.477537 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:33.477887 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:33.477891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:33.478381 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:33.478553 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:33.478562 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.479883 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.479888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:33.480992 (+ 1104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:33.481008 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.481814 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.481819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:33.481978 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:33.482770 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:33.482792 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:33.486662 (+ 3870us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":260,"threads_started":1}
W20260805 23:01:33.487283 3207 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:33.477089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:37487 (local address 127.22.45.126:45961)
0805 23:01:33.477343 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:33.477349 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:33.477468 (+ 119us) server_negotiation.cc:407] Connection header received
0805 23:01:33.477673 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:33.477678 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:33.477745 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:33.477833 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:33.478725 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.479711 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.481165 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.481636 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.481762 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:33.487054 (+ 5292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:37487: BlockingRecv error: recv got EOF from 127.22.45.67:37487 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 05 23:01:33 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:33 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:33.797837 3210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:33.786811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:58927)
0805 23:01:33.787495 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:33.787514 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:33.787670 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:33.788038 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:33.788042 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:33.788544 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:33.788745 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:33.788756 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.789914 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.789918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:33.790994 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:33.791009 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.791995 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.792000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:33.792143 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:33.793198 (+ 1055us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:33.793219 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:33.797460 (+ 4241us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":333,"threads_started":1}
W20260805 23:01:33.797945 3207 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:33.786993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:58927 (local address 127.22.45.126:45961)
0805 23:01:33.787180 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:33.787185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:33.787670 (+ 485us) server_negotiation.cc:407] Connection header received
0805 23:01:33.787779 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:33.787783 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:33.787872 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:33.787970 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:33.788926 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.789742 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.791172 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:33.791777 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:33.791893 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:33.797716 (+ 5823us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:58927: BlockingRecv error: recv got EOF from 127.22.45.66:58927 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 05 23:01:34 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:34 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:34.416590 3211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:34.406661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:54423)
0805 23:01:34.407389 (+ 728us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:34.407409 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:34.407561 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:34.407909 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:34.407914 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:34.408410 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:34.408607 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:34.408619 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.409769 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.409773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:34.410760 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:34.410774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.411653 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.411660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:34.411833 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:34.412595 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:34.412623 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:34.416258 (+ 3635us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":380,"threads_started":1}
W20260805 23:01:34.416780 3214 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:34.406797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:54423 (local address 127.22.45.126:45961)
0805 23:01:34.407372 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:34.407378 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:34.407498 (+ 120us) server_negotiation.cc:407] Connection header received
0805 23:01:34.407683 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:34.407689 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:34.407756 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:34.407852 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:34.408796 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.409608 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.410964 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.411439 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.411577 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:34.416537 (+ 4960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:54423: BlockingRecv error: recv got EOF from 127.22.45.65:54423 (error 108)
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":324,"threads_started":1}
Aug 05 23:01:34 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:34 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:34.498767 3215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:34.488097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:41979)
0805 23:01:34.488746 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:34.488765 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:34.488901 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:34.489263 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:34.489267 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:34.489709 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:34.489885 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:34.489894 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.491122 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.491127 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:34.492132 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:34.492147 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.493141 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.493147 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:34.493290 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:34.494005 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:34.494024 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:34.498392 (+ 4368us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":298,"threads_started":1}
W20260805 23:01:34.499182 3214 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:34.488319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:41979 (local address 127.22.45.126:45961)
0805 23:01:34.488498 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:34.488503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:34.488883 (+ 380us) server_negotiation.cc:407] Connection header received
0805 23:01:34.489048 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:34.489052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:34.489122 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:34.489222 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:34.490059 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.490898 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.492322 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.492912 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.493032 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:34.498834 (+ 5802us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:41979: BlockingRecv error: recv got EOF from 127.22.45.67:41979 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 05 23:01:34 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:34 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:34.813374 3216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:34.798902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:40283)
0805 23:01:34.799534 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:34.799553 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:34.799682 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:34.800026 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:34.800029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:34.800463 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:34.800656 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:34.800666 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.801888 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.801893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:34.802894 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:34.802909 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.803735 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.803740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:34.803869 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:34.808879 (+ 5010us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:34.808903 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:34.813016 (+ 4113us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":304,"threads_started":1}
W20260805 23:01:34.813580 3214 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:34.799112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:40283 (local address 127.22.45.126:45961)
0805 23:01:34.799320 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:34.799325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:34.799663 (+ 338us) server_negotiation.cc:407] Connection header received
0805 23:01:34.799819 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:34.799823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:34.799912 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:34.799993 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:34.800769 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.801683 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.803104 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:34.803556 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:34.803652 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:34.813308 (+ 9656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:40283: BlockingRecv error: recv got EOF from 127.22.45.66:40283 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 05 23:01:35 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:35 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:35.428471 3217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:35.417871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:59435)
0805 23:01:35.418437 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:35.418456 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:35.418578 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:35.419169 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:35.419174 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:35.419634 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:35.419833 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:35.419843 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.421111 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.421118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:35.422367 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:35.422386 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.423322 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.423334 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:35.423511 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:35.424211 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:35.424238 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:35.428134 (+ 3896us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":313,"threads_started":1}
W20260805 23:01:35.428671 3220 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:35.418251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:59435 (local address 127.22.45.126:45961)
0805 23:01:35.418796 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:35.418801 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:35.418819 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:01:35.418878 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:35.418881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:35.418970 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:35.419074 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:35.420026 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.420797 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.422553 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.423109 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.423243 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:35.428399 (+ 5156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:59435: BlockingRecv error: recv got EOF from 127.22.45.65:59435 (error 108)
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":270,"threads_started":1}
Aug 05 23:01:35 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:35 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:35.510423 3222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:35.500233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:39005)
0805 23:01:35.500897 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:35.500918 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:35.501070 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:35.501424 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:35.501429 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:35.501990 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:35.502184 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:35.502197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.503575 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.503579 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:35.504535 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:35.504549 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.505350 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.505355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:35.505533 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:35.506329 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:35.506350 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:35.510150 (+ 3800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":336,"threads_started":1}
W20260805 23:01:35.510689 3220 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:35.500426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:39005 (local address 127.22.45.126:45961)
0805 23:01:35.500654 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:35.500660 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:35.501016 (+ 356us) server_negotiation.cc:407] Connection header received
0805 23:01:35.501205 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:35.501209 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:35.501277 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:35.501368 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:35.502405 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.503408 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.504694 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.505124 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.505236 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:35.510459 (+ 5223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:39005: BlockingRecv error: recv got EOF from 127.22.45.67:39005 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
Aug 05 23:01:35 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:35 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:35.824467 3223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:35.814504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:46521)
0805 23:01:35.815106 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:35.815125 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:35.815258 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:35.815573 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:35.815576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:35.816022 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:35.816194 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:35.816204 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.817322 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.817327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:35.818356 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:35.818376 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.819282 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.819288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:35.819481 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:35.820201 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:35.820223 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:35.824167 (+ 3944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":312,"threads_started":1}
W20260805 23:01:35.824669 3220 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:35.814641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:46521 (local address 127.22.45.126:45961)
0805 23:01:35.814879 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:35.814886 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:35.815215 (+ 329us) server_negotiation.cc:407] Connection header received
0805 23:01:35.815363 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:35.815367 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:35.815454 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:35.815543 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:35.816351 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.817110 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.818516 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:35.819084 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:35.819212 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:35.824420 (+ 5208us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:46521: BlockingRecv error: recv got EOF from 127.22.45.66:46521 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 05 23:01:36 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:36 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:36.440145 3224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:36.429593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:33707)
0805 23:01:36.430533 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:36.430559 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:36.430692 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:36.431123 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:36.431127 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:36.431580 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:36.431830 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:36.431844 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.433243 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.433247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:36.434469 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:36.434486 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.435326 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.435331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:36.435512 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:36.436193 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:36.436220 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:36.439890 (+ 3670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":828,"thread_start_us":698,"threads_started":1}
W20260805 23:01:36.440550 3227 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:36.429795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:33707 (local address 127.22.45.126:45961)
0805 23:01:36.430385 (+ 590us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:36.430392 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:36.430646 (+ 254us) server_negotiation.cc:407] Connection header received
0805 23:01:36.430807 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:36.430813 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:36.430901 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:36.431047 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:36.432028 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.433047 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.434631 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.435162 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.435280 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:36.440254 (+ 4974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:33707: BlockingRecv error: recv got EOF from 127.22.45.65:33707 (error 108)
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":288,"threads_started":1}
Aug 05 23:01:36 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:36 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:36.522379 3229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:36.511548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:38779)
0805 23:01:36.512220 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:36.512242 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:36.512387 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:36.512759 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:36.512763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:36.513235 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:36.513412 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:36.513423 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.514989 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.514993 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:36.515994 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:36.516009 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.517031 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.517036 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:36.517187 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:36.517847 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:36.517867 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:36.522021 (+ 4154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":347,"threads_started":1}
W20260805 23:01:36.523087 3227 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:36.511583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:38779 (local address 127.22.45.126:45961)
0805 23:01:36.511768 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:36.511775 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:36.512349 (+ 574us) server_negotiation.cc:407] Connection header received
0805 23:01:36.512501 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:36.512508 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:36.512599 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:36.512720 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:36.513569 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.514779 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.516188 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.516868 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.517005 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:36.522626 (+ 5621us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:38779: BlockingRecv error: recv got EOF from 127.22.45.67:38779 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 05 23:01:36 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:36 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:36.834872 3230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:36.825669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:37001)
0805 23:01:36.826194 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:36.826212 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:36.826334 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:36.826644 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:36.826647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:36.827088 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:36.827287 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:36.827297 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.828279 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.828282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:36.829285 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:36.829299 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.830048 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.830052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:36.830173 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:36.830828 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:36.830847 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:36.834592 (+ 3745us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":254,"threads_started":1}
W20260805 23:01:36.835191 3227 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:36.825786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:37001 (local address 127.22.45.126:45961)
0805 23:01:36.825999 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:36.826006 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:36.826291 (+ 285us) server_negotiation.cc:407] Connection header received
0805 23:01:36.826450 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:36.826454 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:36.826523 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:36.826615 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:36.827413 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.828165 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.829455 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:36.829871 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:36.829971 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:36.834878 (+ 4907us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:37001: BlockingRecv error: recv got EOF from 127.22.45.66:37001 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 05 23:01:37 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:37 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:37.450804 3231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:37.441178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:46045)
0805 23:01:37.441698 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:37.441723 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:37.441833 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:37.442109 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:37.442112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:37.442570 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:37.442766 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:37.442775 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.444191 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.444195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:37.445129 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:37.445142 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.445807 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.445811 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:37.445924 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:37.446556 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:37.446576 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:37.450466 (+ 3890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":277,"threads_started":1}
W20260805 23:01:37.451143 3233 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:37.441330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:46045 (local address 127.22.45.126:45961)
0805 23:01:37.441815 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:37.441820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:37.441837 (+ 17us) server_negotiation.cc:407] Connection header received
0805 23:01:37.441928 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:37.441932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:37.441993 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:37.442080 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:37.442940 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.444051 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.445249 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.445688 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.445780 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:37.450694 (+ 4914us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:46045: BlockingRecv error: recv got EOF from 127.22.45.65:46045 (error 108)
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":284,"threads_started":1}
Aug 05 23:01:37 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:37 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:37.533506 3234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:37.523615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:43433)
0805 23:01:37.524191 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:37.524210 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:37.524341 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:37.524679 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:37.524683 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:37.525230 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:37.525413 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:37.525423 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.526711 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.526716 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:37.527900 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:37.527916 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.528754 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.528760 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:37.528896 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:37.529567 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:37.529587 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:37.533239 (+ 3652us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":320,"threads_started":1}
W20260805 23:01:37.533723 3233 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:37.523676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:43433 (local address 127.22.45.126:45961)
0805 23:01:37.523884 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:37.523888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:37.524288 (+ 400us) server_negotiation.cc:407] Connection header received
0805 23:01:37.524434 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:37.524438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:37.524504 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:37.524599 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:37.525655 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.526530 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.528075 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.528571 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.528693 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:37.533502 (+ 4809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:43433: BlockingRecv error: recv got EOF from 127.22.45.67:43433 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 05 23:01:37 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:37 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:37.846304 3236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:37.836388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:34775)
0805 23:01:37.836906 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:37.836927 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:37.837075 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:37.837475 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:37.837479 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:37.837979 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:37.838181 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:37.838191 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.839492 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.839497 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:37.840565 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:37.840591 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.841340 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.841346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:37.841526 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:37.842218 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:37.842238 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:37.846041 (+ 3803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":272,"threads_started":1}
W20260805 23:01:37.846670 3233 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:37.836544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:34775 (local address 127.22.45.126:45961)
0805 23:01:37.836810 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:37.836817 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:37.837020 (+ 203us) server_negotiation.cc:407] Connection header received
0805 23:01:37.837242 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:37.837247 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:37.837342 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:37.837435 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:37.838357 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.839329 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.840735 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:37.841179 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:37.841295 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:37.846348 (+ 5053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:34775: BlockingRecv error: recv got EOF from 127.22.45.66:34775 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
Aug 05 23:01:38 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:38 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:38.461673 3237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:38.451796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:54263)
0805 23:01:38.452354 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:38.452371 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:38.452503 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:38.452802 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:38.452805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:38.453272 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:38.453462 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:38.453470 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.454556 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.454561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:38.455704 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:38.455721 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.456451 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.456456 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:38.456615 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:38.457377 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:38.457400 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:38.461282 (+ 3882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":286,"threads_started":1}
W20260805 23:01:38.462062 3238 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:38.451849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:54263 (local address 127.22.45.126:45961)
0805 23:01:38.452323 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:38.452327 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:38.452443 (+ 116us) server_negotiation.cc:407] Connection header received
0805 23:01:38.452604 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:38.452607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:38.452670 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:38.452772 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:38.453583 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.454359 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.455843 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.456272 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.456369 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:38.461530 (+ 5161us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:54263: BlockingRecv error: recv got EOF from 127.22.45.65:54263 (error 108)
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":256,"threads_started":1}
Aug 05 23:01:38 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:38 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:38.544736 3239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:38.534672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:58025)
0805 23:01:38.535391 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:38.535409 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:38.535538 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:38.535888 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:38.535894 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:38.536513 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:38.536759 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:38.536775 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.538080 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.538084 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:38.539088 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:38.539101 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.539900 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.539905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:38.540050 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:38.540741 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:38.540760 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:38.544411 (+ 3651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":610,"thread_start_us":467,"threads_started":1}
W20260805 23:01:38.544935 3238 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:38.534844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:58025 (local address 127.22.45.126:45961)
0805 23:01:38.535061 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:38.535068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:38.535506 (+ 438us) server_negotiation.cc:407] Connection header received
0805 23:01:38.535661 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:38.535665 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:38.535735 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:38.535822 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:38.536918 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.537950 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.539256 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.539706 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.539832 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:38.544712 (+ 4880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:58025: BlockingRecv error: recv got EOF from 127.22.45.67:58025 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 05 23:01:38 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:38 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:38.857568 3240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:38.847580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:60617)
0805 23:01:38.848166 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:38.848186 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:38.848344 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:38.848732 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:38.848736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:38.849179 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:38.849363 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:38.849372 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.850622 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.850627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:38.851898 (+ 1271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:38.851918 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.852755 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.852761 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:38.852948 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:38.853615 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:38.853634 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:38.857189 (+ 3555us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":296,"threads_started":1}
W20260805 23:01:38.857766 3238 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:38.847812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:60617 (local address 127.22.45.126:45961)
0805 23:01:38.848097 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:38.848103 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:38.848304 (+ 201us) server_negotiation.cc:407] Connection header received
0805 23:01:38.848458 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:38.848462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:38.848549 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:38.848651 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:38.849551 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.850456 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.852055 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:38.852586 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:38.852720 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:38.857473 (+ 4753us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:60617: BlockingRecv error: recv got EOF from 127.22.45.66:60617 (error 108)
Metrics: {"server-negotiator.queue_time_us":131}
Aug 05 23:01:39 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:39 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:39.472862 3242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:39.462952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:36795)
0805 23:01:39.463468 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:39.463487 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:39.463615 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:39.464084 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:39.464087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:39.464564 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:39.464728 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:39.464737 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.465825 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.465829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:39.466757 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:39.466771 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.467511 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.467516 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:39.467662 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:39.468373 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:39.468400 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:39.472480 (+ 4080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":268,"threads_started":1}
W20260805 23:01:39.473085 3244 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:39.463081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:36795 (local address 127.22.45.126:45961)
0805 23:01:39.463800 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:39.463805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:39.463823 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:01:39.463877 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:39.463881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:39.463941 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:39.464041 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:39.464879 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.465653 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.466881 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.467370 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.467502 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:39.472801 (+ 5299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:36795: BlockingRecv error: recv got EOF from 127.22.45.65:36795 (error 108)
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":491,"threads_started":1}
Aug 05 23:01:39 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:39 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:39.555503 3245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:39.545716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:57657)
0805 23:01:39.546329 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:39.546347 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:39.546491 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:39.546856 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:39.546861 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:39.547373 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:39.547557 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:39.547566 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.548812 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.548817 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:39.549785 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:39.549800 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.550628 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.550635 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:39.550812 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:39.551552 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:39.551571 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:39.555136 (+ 3565us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":352,"threads_started":1}
W20260805 23:01:39.555671 3244 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:39.545832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:57657 (local address 127.22.45.126:45961)
0805 23:01:39.546109 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:39.546116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:39.546441 (+ 325us) server_negotiation.cc:407] Connection header received
0805 23:01:39.546624 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:39.546628 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:39.546692 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:39.546780 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:39.547719 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.548601 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.549953 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.550408 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.550528 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:39.555427 (+ 4899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:57657: BlockingRecv error: recv got EOF from 127.22.45.67:57657 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 05 23:01:39 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:39 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:39.871371 3246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:39.858561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:60373)
0805 23:01:39.859057 (+ 496us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:39.859079 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:39.859212 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:39.859588 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:39.859593 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:39.860071 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:39.860232 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:39.860242 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.861608 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.861614 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:39.862556 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:39.862570 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.865297 (+ 2727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.865302 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:39.865471 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:39.866200 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:39.866223 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:39.871025 (+ 4802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":273,"threads_started":1}
W20260805 23:01:39.871547 3244 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:39.859003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:60373 (local address 127.22.45.126:45961)
0805 23:01:39.859187 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:39.859193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:39.859215 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:01:39.859372 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:39.859379 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:39.859450 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:39.859536 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:39.860386 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.861424 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.862732 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:39.863445 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:39.863567 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:39.871261 (+ 7694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:60373: BlockingRecv error: recv got EOF from 127.22.45.66:60373 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 05 23:01:40 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:40 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.65@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:40.483960 3248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:40.474353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.65:56333)
0805 23:01:40.474879 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:40.474898 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:40.475063 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:40.475586 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:40.475591 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:40.476030 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:40.476288 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:40.476301 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.477351 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.477354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:40.478338 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:40.478350 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.479102 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.479106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:40.479268 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:40.479909 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:40.479929 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:40.483662 (+ 3733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":263,"threads_started":1}
W20260805 23:01:40.484179 3250 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:40.474452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:56333 (local address 127.22.45.126:45961)
0805 23:01:40.475281 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:40.475287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:40.475302 (+ 15us) server_negotiation.cc:407] Connection header received
0805 23:01:40.475346 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:40.475350 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:40.475409 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:40.475494 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:40.476450 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.477232 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.478456 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.478972 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.479076 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:40.483960 (+ 4884us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.65:56333: BlockingRecv error: recv got EOF from 127.22.45.65:56333 (error 108)
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":570,"threads_started":1}
Aug 05 23:01:40 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:40 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.67@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:40.567267 3251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:40.557008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.67:53979)
0805 23:01:40.557575 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:40.557597 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:40.557772 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:40.558117 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:40.558121 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:40.558589 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:40.558752 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:40.558762 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.559910 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.559914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:40.560854 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:40.560868 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.561654 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.561660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:40.561840 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:40.562508 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:40.562527 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:40.566879 (+ 4352us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":301,"threads_started":1}
W20260805 23:01:40.567417 3250 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:40.557217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:53979 (local address 127.22.45.126:45961)
0805 23:01:40.557577 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:40.557583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:40.557688 (+ 105us) server_negotiation.cc:407] Connection header received
0805 23:01:40.557902 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:40.557906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:40.557972 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:40.558058 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:40.558941 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.559747 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.561022 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.561478 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.561597 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:40.567169 (+ 5572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.67:53979: BlockingRecv error: recv got EOF from 127.22.45.67:53979 (error 108)
Metrics: {"server-negotiator.queue_time_us":222}
Aug 05 23:01:40 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
Aug 05 23:01:40 dist-test-slave-1vmg krb5kdc[1742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.45.66@KRBTEST.COM for oryx/127.22.45.126@KRBTEST.COM, Server not found in Kerberos database
I20260805 23:01:40.882884 3252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:40.873094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:45961 (local address 127.22.45.66:53833)
0805 23:01:40.873648 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:40.873671 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:40.873819 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:40.874207 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:40.874212 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:40.874686 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:40.874882 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:40.874894 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.876047 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.876053 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:40.877035 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:40.877051 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.877854 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.877861 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:40.878046 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:40.878853 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:40.878874 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:40.882528 (+ 3654us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.45.126:45961: Server oryx/127.22.45.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":277,"threads_started":1}
W20260805 23:01:40.883104 3250 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:40.873312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:53833 (local address 127.22.45.126:45961)
0805 23:01:40.873588 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:40.873594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:40.873765 (+ 171us) server_negotiation.cc:407] Connection header received
0805 23:01:40.873950 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:40.873954 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:40.874040 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:40.874129 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:40.875091 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.875882 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.877210 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:40.877673 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:40.877792 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:40.882801 (+ 5009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.45.66:53833: BlockingRecv error: recv got EOF from 127.22.45.66:53833 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
I20260805 23:01:41.364264 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2549
I20260805 23:01:41.377493 3254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:41.365576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59134 (local address 127.22.45.65:35499)
0805 23:01:41.366178 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:41.366186 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:41.366214 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:01:41.366288 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:41.366295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:41.366543 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:41.366722 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:41.368257 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:41.369335 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:41.370577 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:41.371239 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:41.371350 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:41.374054 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:41.374064 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:41.374081 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:41.374139 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:41.376913 (+ 2774us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.22.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0805 23:01:41.377258 (+ 345us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59134: Request ticket server kudu/127.22.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":309,"threads_started":1}
W20260805 23:01:41.377614 3254 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59134: Request ticket server kudu/127.22.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260805 23:01:41.377759 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2549: Not authorized: Client connection negotiation failed: client connection to 127.22.45.65:35499: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.22.45.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260805 23:01:41.377961 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 2549
I20260805 23:01:41.407289 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2771
I20260805 23:01:41.421496 3256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:41.408517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46542 (local address 127.22.45.66:34337)
0805 23:01:41.409146 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:41.409153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:41.409182 (+ 29us) server_negotiation.cc:407] Connection header received
0805 23:01:41.409260 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:41.409267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:41.409539 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:41.409753 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:41.411261 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:41.412415 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:41.413775 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:41.414413 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:41.414552 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:41.417616 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:41.417627 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:41.417644 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:41.417693 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:41.420704 (+ 3011us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.22.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0805 23:01:41.421153 (+ 449us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46542: Request ticket server kudu/127.22.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":319,"threads_started":1}
W20260805 23:01:41.421628 3256 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46542: Request ticket server kudu/127.22.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260805 23:01:41.421635 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2771: Not authorized: Client connection negotiation failed: client connection to 127.22.45.66:34337: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.22.45.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260805 23:01:41.421826 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 2771
I20260805 23:01:41.445762 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2969
I20260805 23:01:41.458287 3257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:41.446864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.22.45.67:45033)
0805 23:01:41.447462 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:41.447472 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:41.447509 (+ 37us) server_negotiation.cc:407] Connection header received
0805 23:01:41.447664 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:41.447674 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:41.448006 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:41.448233 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:41.449514 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:41.450544 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:41.451714 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:41.452269 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:41.452371 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:41.454845 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:41.454855 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:41.454871 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:41.454978 (+ 107us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:41.457685 (+ 2707us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.22.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0805 23:01:41.458022 (+ 337us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36526: Request ticket server kudu/127.22.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":282,"threads_started":1}
W20260805 23:01:41.458395 3257 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36526: Request ticket server kudu/127.22.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260805 23:01:41.458467 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2969: Not authorized: Client connection negotiation failed: client connection to 127.22.45.67:45033: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.22.45.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260805 23:01:41.458662 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 2969
I20260805 23:01:41.479684 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 2451
I20260805 23:01:41.481307 2539 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:41.601235 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 2451
2026-08-05T23:01:41Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22039 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-05T23:01:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:41Z Disabled control of system clock
I20260805 23:01:41.694847 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39753
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39753
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260805 23:01:42.058503 3263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:42.058867 3263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:42.059001 3263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:42.067070 3263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:42.067221 3263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:42.067268 3263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:42.067329 3263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:42.067374 3263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:42.077363 3263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39753
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:42.078837 3263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:42.080991 3263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:42.094295 3268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:42.094166 3271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:42.094223 3269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:42.095371 3263 server_base.cc:1034] running on GCE node
I20260805 23:01:42.096304 3263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:42.097975 3263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:42.099218 3263 hybrid_clock.cc:648] HybridClock initialized: now 1785970902099164 us; error 38 us; skew 500 ppm
I20260805 23:01:42.099632 3263 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:42.102344 3263 webserver.cc:460] Webserver started at http://127.22.45.126:35533/ using document root <none> and password file <none>
I20260805 23:01:42.103246 3263 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:42.103372 3263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:42.103734 3263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:42.107195 3263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "263f5e7994524a11943b34e52a27fa09"
format_stamp: "Formatted at 2026-08-05 23:01:42 on dist-test-slave-1vmg"
server_key: "190df7e6f30c04fb6979520d38e36801"
server_key_iv: "03e453b4ba52228d6e1596e7c77a28a0"
server_key_version: "encryptionkey@0"
I20260805 23:01:42.108187 3263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "263f5e7994524a11943b34e52a27fa09"
format_stamp: "Formatted at 2026-08-05 23:01:42 on dist-test-slave-1vmg"
server_key: "190df7e6f30c04fb6979520d38e36801"
server_key_iv: "03e453b4ba52228d6e1596e7c77a28a0"
server_key_version: "encryptionkey@0"
I20260805 23:01:42.114523 3263 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 23:01:42.118714 3278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:42.120560 3263 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:01:42.120801 3263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "263f5e7994524a11943b34e52a27fa09"
format_stamp: "Formatted at 2026-08-05 23:01:42 on dist-test-slave-1vmg"
server_key: "190df7e6f30c04fb6979520d38e36801"
server_key_iv: "03e453b4ba52228d6e1596e7c77a28a0"
server_key_version: "encryptionkey@0"
I20260805 23:01:42.121057 3263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:42.147972 3263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:42.148960 3263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:42.149293 3263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:42.168282 3263 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:39753
I20260805 23:01:42.168303 3348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:39753 every 8 connection(s)
I20260805 23:01:42.169905 3263 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:01:42.174404 3349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:42.175318 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 3263
I20260805 23:01:42.175529 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:01:42.176429 22709 external_mini_cluster.cc:1428] Setting key 3327ddccd9262ed14353782712c9422b
I20260805 23:01:42.190553 3349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09: Bootstrap starting.
I20260805 23:01:42.192827 3353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:42.178899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58414 (local address 127.22.45.126:39753)
0805 23:01:42.180096 (+ 1197us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:42.180108 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:42.180161 (+ 53us) server_negotiation.cc:407] Connection header received
0805 23:01:42.181978 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:42.182007 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:42.182627 (+ 620us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:42.183098 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:42.183909 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:42.185266 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:42.187409 (+ 2143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:42.188347 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:42.188537 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:42.189971 (+ 1434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:42.189980 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:42.189999 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:42.190647 (+ 648us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:42.190782 (+ 135us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:42.190811 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:42.190935 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:42.191250 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 23:01:42.191681 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":638,"thread_start_us":385,"threads_started":1}
I20260805 23:01:42.194418 3349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:42.195962 3349 log.cc:824] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:42.199426 3349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09: No bootstrap required, opened a new log
I20260805 23:01:42.207681 3349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263f5e7994524a11943b34e52a27fa09" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39753 } }
I20260805 23:01:42.208171 3349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:42.208333 3349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 263f5e7994524a11943b34e52a27fa09, State: Initialized, Role: FOLLOWER
I20260805 23:01:42.208961 3349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263f5e7994524a11943b34e52a27fa09" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39753 } }
I20260805 23:01:42.209215 3349 raft_consensus.cc:388] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:01:42.209368 3349 raft_consensus.cc:482] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:01:42.209537 3349 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:42.212059 3349 raft_consensus.cc:504] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263f5e7994524a11943b34e52a27fa09" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39753 } }
I20260805 23:01:42.212692 3349 leader_election.cc:302] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 263f5e7994524a11943b34e52a27fa09; no voters:
I20260805 23:01:42.213379 3349 leader_election.cc:288] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:01:42.213548 3356 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:42.214284 3356 raft_consensus.cc:686] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [term 1 LEADER]: Becoming Leader. State: Replica: 263f5e7994524a11943b34e52a27fa09, State: Running, Role: LEADER
I20260805 23:01:42.214934 3356 consensus_queue.cc:237] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263f5e7994524a11943b34e52a27fa09" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39753 } }
I20260805 23:01:42.215902 3349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:42.218216 3357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "263f5e7994524a11943b34e52a27fa09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263f5e7994524a11943b34e52a27fa09" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39753 } } }
I20260805 23:01:42.218309 3358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 263f5e7994524a11943b34e52a27fa09. Latest consensus state: current_term: 1 leader_uuid: "263f5e7994524a11943b34e52a27fa09" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "263f5e7994524a11943b34e52a27fa09" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39753 } } }
I20260805 23:01:42.218659 3357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:42.219651 3358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09 [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:42.221294 3367 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:42.226888 3367 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:42.237284 3367 catalog_manager.cc:1347] Generated new cluster ID: cf1ef15067734507a3eb1c8fb4572cda
I20260805 23:01:42.237426 3367 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:42.255811 3367 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:01:42.257880 3367 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:42.281409 3367 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 263f5e7994524a11943b34e52a27fa09: Generated new TSK 0
I20260805 23:01:42.282675 3367 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:01:42.296945 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39753
--builtin_ntp_servers=127.22.45.84:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260805 23:01:42.667378 3383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:42.667734 3383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:42.667861 3383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:42.675473 3383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:42.675621 3383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:42.675768 3383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:42.685503 3383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:42.686975 3383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:42.688915 3383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:42.703619 3389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:42.703581 3393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:42.703666 3390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:42.716651 3383 server_base.cc:1034] running on GCE node
I20260805 23:01:42.717453 3383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:42.718597 3383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:42.719852 3383 hybrid_clock.cc:648] HybridClock initialized: now 1785970902719767 us; error 73 us; skew 500 ppm
I20260805 23:01:42.720279 3383 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:42.722966 3383 webserver.cc:460] Webserver started at http://127.22.45.65:39269/ using document root <none> and password file <none>
I20260805 23:01:42.723755 3383 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:42.723857 3383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:42.724175 3383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:42.727770 3383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "5857524cb6524b5a97db3a290b05a817"
format_stamp: "Formatted at 2026-08-05 23:01:42 on dist-test-slave-1vmg"
server_key: "9586aa94a81af6e4162940b4df2d8005"
server_key_iv: "a816eda9fcc60e04cdc4217c71e84f38"
server_key_version: "encryptionkey@0"
I20260805 23:01:42.728734 3383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "5857524cb6524b5a97db3a290b05a817"
format_stamp: "Formatted at 2026-08-05 23:01:42 on dist-test-slave-1vmg"
server_key: "9586aa94a81af6e4162940b4df2d8005"
server_key_iv: "a816eda9fcc60e04cdc4217c71e84f38"
server_key_version: "encryptionkey@0"
I20260805 23:01:42.734691 3383 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260805 23:01:42.738407 3401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:42.739897 3383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:01:42.740067 3383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "5857524cb6524b5a97db3a290b05a817"
format_stamp: "Formatted at 2026-08-05 23:01:42 on dist-test-slave-1vmg"
server_key: "9586aa94a81af6e4162940b4df2d8005"
server_key_iv: "a816eda9fcc60e04cdc4217c71e84f38"
server_key_version: "encryptionkey@0"
I20260805 23:01:42.740298 3383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:42.755229 3383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:42.756460 3383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:42.756764 3383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:42.757807 3383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:42.759434 3383 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:42.759531 3383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:42.759625 3383 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:42.759682 3383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:42.793121 3383 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:45425
I20260805 23:01:42.793156 3563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:45425 every 8 connection(s)
I20260805 23:01:42.794602 3383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:42.796439 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 3383
I20260805 23:01:42.796635 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:01:42.797324 22709 external_mini_cluster.cc:1428] Setting key bfac80be8230dcce3c036a9ef507aa2f
I20260805 23:01:42.800312 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39753
--builtin_ntp_servers=127.22.45.84:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260805 23:01:42.808633 3566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:42.797551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:54681 (local address 127.22.45.126:39753)
0805 23:01:42.798071 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:42.798077 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:42.799500 (+ 1423us) server_negotiation.cc:407] Connection header received
0805 23:01:42.801528 (+ 2028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:42.801535 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:42.801629 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:42.801732 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:42.803025 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:42.803786 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:42.805526 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:42.805955 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:42.806084 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:42.807658 (+ 1574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:42.807663 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:42.807666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:42.807692 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:42.807739 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:42.807752 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:42.807835 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:42.808106 (+ 271us) server_negotiation.cc:299] Negotiation successful
0805 23:01:42.808240 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":256,"threads_started":1}
I20260805 23:01:42.809787 3567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:42.798150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39753 (local address 127.22.45.65:54681)
0805 23:01:42.799335 (+ 1185us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:42.799394 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:42.801199 (+ 1805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:42.802025 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:42.802035 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:42.802138 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:42.802804 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:42.802824 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:42.803959 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:42.803964 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:42.805332 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:42.805348 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:42.806221 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:42.806230 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:42.806472 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:42.807281 (+ 809us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:01:42.807284 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:42.807330 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:01:42.807426 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:42.807849 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:42.807862 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:42.807870 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 23:01:42.808056 (+ 186us) client_negotiation.cc:240] Negotiation successful
0805 23:01:42.808527 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":324,"threads_started":1}
I20260805 23:01:42.811800 3564 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39753
I20260805 23:01:42.812131 3564 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:42.813036 3564 heartbeater.cc:511] Master 127.22.45.126:39753 requested a full tablet report, sending...
I20260805 23:01:42.815793 3301 ts_manager.cc:194] Registered new tserver with Master: 5857524cb6524b5a97db3a290b05a817 (127.22.45.65:45425)
I20260805 23:01:42.817986 3301 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.65:54681
W20260805 23:01:43.159596 3568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:43.159950 3568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:43.160061 3568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:43.168591 3568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:43.168797 3568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:43.168985 3568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:43.184281 3568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:43.186085 3568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:43.188673 3568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:43.203992 3576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:43.204031 3577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:43.204062 3583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:43.204788 3568 server_base.cc:1034] running on GCE node
I20260805 23:01:43.205613 3568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:43.206682 3568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:43.207899 3568 hybrid_clock.cc:648] HybridClock initialized: now 1785970903207834 us; error 60 us; skew 500 ppm
I20260805 23:01:43.208250 3568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:43.210801 3568 webserver.cc:460] Webserver started at http://127.22.45.66:40739/ using document root <none> and password file <none>
I20260805 23:01:43.211643 3568 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:43.211759 3568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:43.212117 3568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:43.215327 3568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "1fe2b68413a74543af216dd045f12d86"
format_stamp: "Formatted at 2026-08-05 23:01:43 on dist-test-slave-1vmg"
server_key: "7dc888052f3eca7a49c20f65067defd9"
server_key_iv: "a1537db36bbfed8e390e2ff66c72ae32"
server_key_version: "encryptionkey@0"
I20260805 23:01:43.216262 3568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "1fe2b68413a74543af216dd045f12d86"
format_stamp: "Formatted at 2026-08-05 23:01:43 on dist-test-slave-1vmg"
server_key: "7dc888052f3eca7a49c20f65067defd9"
server_key_iv: "a1537db36bbfed8e390e2ff66c72ae32"
server_key_version: "encryptionkey@0"
I20260805 23:01:43.222617 3568 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:01:43.227072 3589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:43.228823 3568 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:01:43.229055 3568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "1fe2b68413a74543af216dd045f12d86"
format_stamp: "Formatted at 2026-08-05 23:01:43 on dist-test-slave-1vmg"
server_key: "7dc888052f3eca7a49c20f65067defd9"
server_key_iv: "a1537db36bbfed8e390e2ff66c72ae32"
server_key_version: "encryptionkey@0"
I20260805 23:01:43.229317 3568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:43.253417 3568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:43.254499 3568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:43.254846 3568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:43.256003 3568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:43.257680 3568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:43.257798 3568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:43.257921 3568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:43.257995 3568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:43.291502 3568 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:36903
I20260805 23:01:43.291567 3747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:36903 every 8 connection(s)
I20260805 23:01:43.292991 3568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:43.302768 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 3568
I20260805 23:01:43.302956 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:01:43.303423 22709 external_mini_cluster.cc:1428] Setting key 57e2a22f0514e05063e8254f2c57c5f3
I20260805 23:01:43.306613 3566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:43.295765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:39963 (local address 127.22.45.126:39753)
0805 23:01:43.295954 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:43.295958 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:43.297516 (+ 1558us) server_negotiation.cc:407] Connection header received
0805 23:01:43.299526 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:43.299531 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:43.299631 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:43.299741 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:43.300978 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.301734 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.303554 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.304022 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.304179 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:43.305839 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:43.305844 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:43.305847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:43.305867 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:43.305903 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:43.305915 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:43.305986 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:43.306266 (+ 280us) server_negotiation.cc:299] Negotiation successful
0805 23:01:43.306357 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:01:43.306672 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39753
--builtin_ntp_servers=127.22.45.84:45173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260805 23:01:43.308348 3750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:43.296285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39753 (local address 127.22.45.66:39963)
0805 23:01:43.297297 (+ 1012us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:43.297349 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:43.299185 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:43.300018 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:43.300027 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:43.300131 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:43.300785 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:43.300805 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.301914 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.301918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:43.303390 (+ 1472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:43.303406 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.304363 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.304373 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:43.304680 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:43.305431 (+ 751us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:01:43.305434 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:43.305486 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:01:43.305620 (+ 134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:43.306013 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:43.306025 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:43.306034 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 23:01:43.306271 (+ 237us) client_negotiation.cc:240] Negotiation successful
0805 23:01:43.306788 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":301,"threads_started":1}
I20260805 23:01:43.310091 3748 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39753
I20260805 23:01:43.310532 3748 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:43.311643 3748 heartbeater.cc:511] Master 127.22.45.126:39753 requested a full tablet report, sending...
I20260805 23:01:43.313597 3301 ts_manager.cc:194] Registered new tserver with Master: 1fe2b68413a74543af216dd045f12d86 (127.22.45.66:36903)
I20260805 23:01:43.314445 3301 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.66:39963
W20260805 23:01:43.669860 3751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:43.670235 3751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:43.670372 3751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:43.678027 3751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:43.678181 3751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:43.678331 3751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:43.688103 3751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39753
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:43.689674 3751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:43.691795 3751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:43.708639 3757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:43.708669 3759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:43.708714 3756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:43.709604 3751 server_base.cc:1034] running on GCE node
I20260805 23:01:43.710454 3751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:43.711903 3751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:43.713164 3751 hybrid_clock.cc:648] HybridClock initialized: now 1785970903713107 us; error 56 us; skew 500 ppm
I20260805 23:01:43.713546 3751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:43.717584 3751 webserver.cc:460] Webserver started at http://127.22.45.67:33105/ using document root <none> and password file <none>
I20260805 23:01:43.718735 3751 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:43.718901 3751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:43.719453 3751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:43.723196 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "e37bb1d09c0c4c3986a56ac89d51023a"
format_stamp: "Formatted at 2026-08-05 23:01:43 on dist-test-slave-1vmg"
server_key: "1137e321e5e39f25eddd48b42e9c845a"
server_key_iv: "b6cf1df4d7fea5e8eb01248af0e640e9"
server_key_version: "encryptionkey@0"
I20260805 23:01:43.724141 3751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "e37bb1d09c0c4c3986a56ac89d51023a"
format_stamp: "Formatted at 2026-08-05 23:01:43 on dist-test-slave-1vmg"
server_key: "1137e321e5e39f25eddd48b42e9c845a"
server_key_iv: "b6cf1df4d7fea5e8eb01248af0e640e9"
server_key_version: "encryptionkey@0"
I20260805 23:01:43.730476 3751 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 23:01:43.735900 3768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:43.737968 3751 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
I20260805 23:01:43.738309 3751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "e37bb1d09c0c4c3986a56ac89d51023a"
format_stamp: "Formatted at 2026-08-05 23:01:43 on dist-test-slave-1vmg"
server_key: "1137e321e5e39f25eddd48b42e9c845a"
server_key_iv: "b6cf1df4d7fea5e8eb01248af0e640e9"
server_key_version: "encryptionkey@0"
I20260805 23:01:43.738612 3751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:43.754266 3751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:43.755362 3751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:43.755692 3751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:43.756827 3751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:43.758555 3751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:43.758674 3751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:43.758805 3751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:43.758880 3751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:43.793125 3751 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46115
I20260805 23:01:43.793157 3922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46115 every 8 connection(s)
I20260805 23:01:43.794625 3751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:43.800223 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 3751
I20260805 23:01:43.800379 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:01:43.800840 22709 external_mini_cluster.cc:1428] Setting key 3b1dc90bcfc9b50fc7f7629e04b6ae70
I20260805 23:01:43.808419 3566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:43.797679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:44355 (local address 127.22.45.126:39753)
0805 23:01:43.797910 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:43.797916 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:43.799467 (+ 1551us) server_negotiation.cc:407] Connection header received
0805 23:01:43.801486 (+ 2019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:43.801492 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:43.801601 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:43.801707 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:43.802948 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.803744 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.805436 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.805844 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.805962 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:43.807535 (+ 1573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:43.807540 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:43.807544 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:43.807567 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:43.807601 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:43.807613 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:43.807691 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:43.807936 (+ 245us) server_negotiation.cc:299] Negotiation successful
0805 23:01:43.808056 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 23:01:43.809701 3926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:43.798203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39753 (local address 127.22.45.67:44355)
0805 23:01:43.799281 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:43.799323 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:43.801151 (+ 1828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:43.801979 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:43.801989 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:43.802103 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:43.802740 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:43.802759 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.803905 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.803909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:43.805269 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:43.805285 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.806103 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.806111 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:43.806347 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:43.807147 (+ 800us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:01:43.807150 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:43.807206 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:01:43.807303 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:43.807706 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:43.807717 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:43.807726 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 23:01:43.807910 (+ 184us) client_negotiation.cc:240] Negotiation successful
0805 23:01:43.808383 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":280,"threads_started":1}
I20260805 23:01:43.811267 3924 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39753
I20260805 23:01:43.811620 3924 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:43.812502 3924 heartbeater.cc:511] Master 127.22.45.126:39753 requested a full tablet report, sending...
I20260805 23:01:43.814217 3301 ts_manager.cc:194] Registered new tserver with Master: e37bb1d09c0c4c3986a56ac89d51023a (127.22.45.67:46115)
I20260805 23:01:43.815323 3301 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.67:44355
I20260805 23:01:43.816671 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:01:43.821817 3564 heartbeater.cc:503] Master 127.22.45.126:39753 was elected leader, sending a full tablet report...
W20260805 23:01:43.824368 3566 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:43.822224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58424 (local address 127.22.45.126:39753)
0805 23:01:43.822412 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:43.822419 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:43.823005 (+ 586us) server_negotiation.cc:407] Connection header received
0805 23:01:43.823284 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:43.823290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:43.823363 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:43.823448 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:43.824092 (+ 644us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58424: BlockingRecv error: recv got EOF from 127.0.0.1:58424 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 23:01:43.825340 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 3383
I20260805 23:01:43.833740 3935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:43.826481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56364 (local address 127.22.45.65:45425)
0805 23:01:43.827137 (+ 656us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:43.827145 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:43.827175 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:01:43.827238 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:43.827244 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:43.827485 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:43.827627 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:43.828061 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.829089 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.830360 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.831078 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.831189 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:43.832257 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:43.832266 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:43.832282 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:43.832929 (+ 647us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:43.832982 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:43.833002 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:43.833098 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:43.833266 (+ 168us) server_negotiation.cc:299] Negotiation successful
0805 23:01:43.833398 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":293,"threads_started":1}
I20260805 23:01:43.835304 3558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:43.918576 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 3383
I20260805 23:01:43.938706 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 3568
I20260805 23:01:43.947471 3938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:43.939759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54058 (local address 127.22.45.66:36903)
0805 23:01:43.940301 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:43.940308 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:43.940335 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:01:43.940397 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:43.940404 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:43.940657 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:43.940813 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:43.941276 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.942310 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.943887 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:43.944524 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:43.944681 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:43.945779 (+ 1098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:43.945789 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:43.945804 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:43.946518 (+ 714us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:43.946584 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:43.946609 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:43.946724 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:43.946946 (+ 222us) server_negotiation.cc:299] Negotiation successful
0805 23:01:43.947109 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":268,"threads_started":1}
I20260805 23:01:43.948937 3742 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:44.033427 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 3568
I20260805 23:01:44.057360 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 3751
I20260805 23:01:44.066635 3941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:44.058553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35700 (local address 127.22.45.67:46115)
0805 23:01:44.059281 (+ 728us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:44.059290 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:44.059332 (+ 42us) server_negotiation.cc:407] Connection header received
0805 23:01:44.059405 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:44.059415 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:44.059760 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:44.059946 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:44.060465 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:44.061829 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:44.063338 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:44.063981 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:44.064092 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:44.065156 (+ 1064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:44.065165 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:44.065181 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:44.065836 (+ 655us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:44.065892 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:44.065922 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:44.066030 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:44.066137 (+ 107us) server_negotiation.cc:299] Negotiation successful
0805 23:01:44.066283 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":564,"thread_start_us":388,"threads_started":1}
I20260805 23:01:44.068269 3916 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:44.153825 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 3751
I20260805 23:01:44.174862 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 3263
I20260805 23:01:44.176077 3342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:44.281638 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 3263
2026-08-05T23:01:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2677 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-05T23:01:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:44Z Disabled control of system clock
I20260805 23:01:44.373735 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35227
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:39651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:35227
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 23:01:44.738101 3949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:44.738472 3949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:44.738564 3949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:44.746383 3949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:44.746546 3949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:44.746583 3949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:44.746640 3949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:44.746686 3949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:44.756752 3949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:39651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:35227
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:44.758169 3949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:44.760263 3949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:44.773638 3954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:44.773581 3955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:44.773603 3957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:44.774322 3949 server_base.cc:1034] running on GCE node
I20260805 23:01:44.775507 3949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:44.777245 3949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:44.778537 3949 hybrid_clock.cc:648] HybridClock initialized: now 1785970904778478 us; error 51 us; skew 500 ppm
I20260805 23:01:44.779089 3949 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:44.782089 3949 webserver.cc:460] Webserver started at http://127.22.45.126:45861/ using document root <none> and password file <none>
I20260805 23:01:44.783053 3949 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:44.783200 3949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:44.783622 3949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:44.789150 3949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "61181a90d250400fb82da68ec4d3aa03"
format_stamp: "Formatted at 2026-08-05 23:01:44 on dist-test-slave-1vmg"
server_key: "a55294efd8a2d2deda574a4d2f4c674c"
server_key_iv: "9f83a9ad3242d1804d2da6c2a75e4781"
server_key_version: "encryptionkey@0"
I20260805 23:01:44.790215 3949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "61181a90d250400fb82da68ec4d3aa03"
format_stamp: "Formatted at 2026-08-05 23:01:44 on dist-test-slave-1vmg"
server_key: "a55294efd8a2d2deda574a4d2f4c674c"
server_key_iv: "9f83a9ad3242d1804d2da6c2a75e4781"
server_key_version: "encryptionkey@0"
I20260805 23:01:44.796900 3949 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:01:44.801017 3968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:44.802657 3949 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 23:01:44.802876 3949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "61181a90d250400fb82da68ec4d3aa03"
format_stamp: "Formatted at 2026-08-05 23:01:44 on dist-test-slave-1vmg"
server_key: "a55294efd8a2d2deda574a4d2f4c674c"
server_key_iv: "9f83a9ad3242d1804d2da6c2a75e4781"
server_key_version: "encryptionkey@0"
I20260805 23:01:44.803164 3949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:44.809710 3949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:44.810678 3949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:44.811079 3949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:44.830261 3949 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:35227
I20260805 23:01:44.830281 4027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:35227 every 8 connection(s)
I20260805 23:01:44.831835 3949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:01:44.835208 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 3949
I20260805 23:01:44.835464 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:01:44.836297 22709 external_mini_cluster.cc:1428] Setting key 8f78bec5f288f8f4f07d606705664d66
I20260805 23:01:44.836813 4029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:44.850361 4038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:44.839103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59218 (local address 127.22.45.126:35227)
0805 23:01:44.840303 (+ 1200us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:44.840315 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:44.840365 (+ 50us) server_negotiation.cc:407] Connection header received
0805 23:01:44.842333 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:44.842363 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:44.842999 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:44.843529 (+ 530us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:44.848229 (+ 4700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:44.848236 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:44.848259 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:44.848284 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:44.848378 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:44.848399 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:44.848684 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:44.848870 (+ 186us) server_negotiation.cc:299] Negotiation successful
0805 23:01:44.849235 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":424,"threads_started":1}
I20260805 23:01:44.851857 4029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03: Bootstrap starting.
I20260805 23:01:44.855547 4029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:44.856765 4029 log.cc:824] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:44.860409 4029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03: No bootstrap required, opened a new log
I20260805 23:01:44.868515 4029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61181a90d250400fb82da68ec4d3aa03" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35227 } }
I20260805 23:01:44.868959 4029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:44.869078 4029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61181a90d250400fb82da68ec4d3aa03, State: Initialized, Role: FOLLOWER
I20260805 23:01:44.869769 4029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61181a90d250400fb82da68ec4d3aa03" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35227 } }
I20260805 23:01:44.870036 4029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:01:44.870183 4029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:01:44.870359 4029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:44.873010 4029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61181a90d250400fb82da68ec4d3aa03" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35227 } }
I20260805 23:01:44.873631 4029 leader_election.cc:302] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 61181a90d250400fb82da68ec4d3aa03; no voters:
I20260805 23:01:44.874318 4029 leader_election.cc:288] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:01:44.874477 4042 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:44.875265 4042 raft_consensus.cc:686] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [term 1 LEADER]: Becoming Leader. State: Replica: 61181a90d250400fb82da68ec4d3aa03, State: Running, Role: LEADER
I20260805 23:01:44.875886 4042 consensus_queue.cc:237] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61181a90d250400fb82da68ec4d3aa03" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35227 } }
I20260805 23:01:44.876628 4029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:44.878727 4045 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "61181a90d250400fb82da68ec4d3aa03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61181a90d250400fb82da68ec4d3aa03" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35227 } } }
I20260805 23:01:44.879209 4045 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:44.878705 4046 sys_catalog.cc:455] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 61181a90d250400fb82da68ec4d3aa03. Latest consensus state: current_term: 1 leader_uuid: "61181a90d250400fb82da68ec4d3aa03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "61181a90d250400fb82da68ec4d3aa03" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35227 } } }
I20260805 23:01:44.879424 4046 sys_catalog.cc:458] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03 [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:44.884500 4049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:44.890481 4049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:44.901479 4049 catalog_manager.cc:1347] Generated new cluster ID: 4870ce6dc36c41c994544076ffa7c4af
I20260805 23:01:44.901625 4049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:44.938884 4049 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:01:44.939440 4049 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:44.952317 4049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 61181a90d250400fb82da68ec4d3aa03: Generated new TSK 0
I20260805 23:01:44.953330 4049 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:01:44.965317 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35227
--builtin_ntp_servers=127.22.45.84:39651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260805 23:01:45.359483 4067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:45.359895 4067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:45.360044 4067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:45.367902 4067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:45.368081 4067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:45.368253 4067 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:45.378291 4067 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:39651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:45.379918 4067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:45.381966 4067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:45.396613 4079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:45.396596 4076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:45.396950 4075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:45.397485 4067 server_base.cc:1034] running on GCE node
I20260805 23:01:45.398190 4067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:45.399345 4067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:45.400563 4067 hybrid_clock.cc:648] HybridClock initialized: now 1785970905400506 us; error 60 us; skew 500 ppm
I20260805 23:01:45.400919 4067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:45.403578 4067 webserver.cc:460] Webserver started at http://127.22.45.65:44603/ using document root <none> and password file <none>
I20260805 23:01:45.404410 4067 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:45.404538 4067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:45.404908 4067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:45.408319 4067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "e8823c5556d64e78a1ab30b49f61db68"
format_stamp: "Formatted at 2026-08-05 23:01:45 on dist-test-slave-1vmg"
server_key: "0cfb3f3fa91a22232126869b3da82968"
server_key_iv: "a902ed71a4446bf84f922ab7f7257d8e"
server_key_version: "encryptionkey@0"
I20260805 23:01:45.409305 4067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "e8823c5556d64e78a1ab30b49f61db68"
format_stamp: "Formatted at 2026-08-05 23:01:45 on dist-test-slave-1vmg"
server_key: "0cfb3f3fa91a22232126869b3da82968"
server_key_iv: "a902ed71a4446bf84f922ab7f7257d8e"
server_key_version: "encryptionkey@0"
I20260805 23:01:45.415997 4067 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260805 23:01:45.420207 4086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:45.421901 4067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:01:45.422117 4067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "e8823c5556d64e78a1ab30b49f61db68"
format_stamp: "Formatted at 2026-08-05 23:01:45 on dist-test-slave-1vmg"
server_key: "0cfb3f3fa91a22232126869b3da82968"
server_key_iv: "a902ed71a4446bf84f922ab7f7257d8e"
server_key_version: "encryptionkey@0"
I20260805 23:01:45.422379 4067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:45.429219 4067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:45.430259 4067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:45.430569 4067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:45.431949 4067 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:45.433689 4067 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:45.433812 4067 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:45.433941 4067 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:45.434016 4067 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:45.468546 4067 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:46015
I20260805 23:01:45.468623 4236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:46015 every 8 connection(s)
I20260805 23:01:45.470002 4067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:45.472499 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 4067
I20260805 23:01:45.472759 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:01:45.473803 22709 external_mini_cluster.cc:1428] Setting key 26d11515833008090b0cacb117820342
I20260805 23:01:45.478267 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35227
--builtin_ntp_servers=127.22.45.84:39651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260805 23:01:45.483029 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:45.473090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:59871 (local address 127.22.45.126:35227)
0805 23:01:45.473586 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:45.473591 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:45.476291 (+ 2700us) server_negotiation.cc:407] Connection header received
0805 23:01:45.479581 (+ 3290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:45.479587 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:45.479673 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:45.479803 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:45.481859 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:45.481875 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:45.481883 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:45.481922 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:45.481984 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:45.482014 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:45.482172 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:45.482449 (+ 277us) server_negotiation.cc:299] Negotiation successful
0805 23:01:45.482520 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":255,"threads_started":1}
I20260805 23:01:45.484563 4240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:45.474285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35227 (local address 127.22.45.65:59871)
0805 23:01:45.476049 (+ 1764us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:45.476113 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:45.479029 (+ 2916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:45.480202 (+ 1173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:45.480217 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:45.480391 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:45.481278 (+ 887us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:01:45.481282 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:45.481343 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:01:45.481499 (+ 156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:45.482144 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:45.482155 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:45.482163 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 23:01:45.482496 (+ 333us) client_negotiation.cc:240] Negotiation successful
0805 23:01:45.482841 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"thread_start_us":579,"threads_started":1}
I20260805 23:01:45.486725 4237 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35227
I20260805 23:01:45.487165 4237 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:45.487995 4237 heartbeater.cc:511] Master 127.22.45.126:35227 requested a full tablet report, sending...
I20260805 23:01:45.490631 3988 ts_manager.cc:194] Registered new tserver with Master: e8823c5556d64e78a1ab30b49f61db68 (127.22.45.65:46015)
W20260805 23:01:45.844405 4242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:45.844739 4242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:45.844836 4242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:45.852795 4242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:45.852941 4242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:45.853096 4242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:45.863085 4242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:39651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:45.864579 4242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:45.866562 4242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:45.880857 4247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:45.880873 4248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:45.881054 4250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:45.881745 4242 server_base.cc:1034] running on GCE node
I20260805 23:01:45.882387 4242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:45.883460 4242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:45.884692 4242 hybrid_clock.cc:648] HybridClock initialized: now 1785970905884617 us; error 62 us; skew 500 ppm
I20260805 23:01:45.885105 4242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:45.887631 4242 webserver.cc:460] Webserver started at http://127.22.45.66:45987/ using document root <none> and password file <none>
I20260805 23:01:45.888417 4242 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:45.888520 4242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:45.888865 4242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:45.892328 4242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "9cce881c28484a248c30e0b9a839c6a5"
format_stamp: "Formatted at 2026-08-05 23:01:45 on dist-test-slave-1vmg"
server_key: "4498118f52efd1267020122cdb708ad6"
server_key_iv: "93c942ec24d7a8473ab66f880760eacb"
server_key_version: "encryptionkey@0"
I20260805 23:01:45.893393 4242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "9cce881c28484a248c30e0b9a839c6a5"
format_stamp: "Formatted at 2026-08-05 23:01:45 on dist-test-slave-1vmg"
server_key: "4498118f52efd1267020122cdb708ad6"
server_key_iv: "93c942ec24d7a8473ab66f880760eacb"
server_key_version: "encryptionkey@0"
I20260805 23:01:45.899499 4242 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 23:01:45.903827 4256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:45.905555 4242 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:01:45.905764 4242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "9cce881c28484a248c30e0b9a839c6a5"
format_stamp: "Formatted at 2026-08-05 23:01:45 on dist-test-slave-1vmg"
server_key: "4498118f52efd1267020122cdb708ad6"
server_key_iv: "93c942ec24d7a8473ab66f880760eacb"
server_key_version: "encryptionkey@0"
I20260805 23:01:45.906023 4242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:45.912674 4242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:45.913676 4242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:45.913977 4242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:45.915091 4242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:45.916756 4242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:45.916853 4242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:45.916967 4242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:45.917037 4242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:45.949867 4242 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:35543
I20260805 23:01:45.949923 4406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:35543 every 8 connection(s)
I20260805 23:01:45.951403 4242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:45.953266 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 4242
I20260805 23:01:45.953483 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:01:45.953984 22709 external_mini_cluster.cc:1428] Setting key 6eb23ba578c5fb0c5a0a3806f15aa0fc
I20260805 23:01:45.957713 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35227
--builtin_ntp_servers=127.22.45.84:39651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260805 23:01:45.961542 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:45.954545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:54133 (local address 127.22.45.126:35227)
0805 23:01:45.954725 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:45.954730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:45.956652 (+ 1922us) server_negotiation.cc:407] Connection header received
0805 23:01:45.959060 (+ 2408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:45.959065 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:45.959127 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:45.959219 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:45.960854 (+ 1635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:45.960859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:45.960862 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:45.960881 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:45.960916 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:45.960928 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:45.961052 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:45.961234 (+ 182us) server_negotiation.cc:299] Negotiation successful
0805 23:01:45.961295 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 23:01:45.962867 4410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:45.955277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35227 (local address 127.22.45.66:54133)
0805 23:01:45.956458 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:45.956518 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:45.958701 (+ 2183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:45.959524 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:45.959535 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:45.959675 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:45.960449 (+ 774us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:01:45.960452 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:45.960522 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:01:45.960644 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:45.961028 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:45.961037 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:45.961045 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 23:01:45.961329 (+ 284us) client_negotiation.cc:240] Negotiation successful
0805 23:01:45.961631 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":608,"thread_start_us":391,"threads_started":1}
I20260805 23:01:45.964463 4407 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35227
I20260805 23:01:45.964808 4407 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:45.965427 4407 heartbeater.cc:511] Master 127.22.45.126:35227 requested a full tablet report, sending...
I20260805 23:01:45.967024 3988 ts_manager.cc:194] Registered new tserver with Master: 9cce881c28484a248c30e0b9a839c6a5 (127.22.45.66:35543)
W20260805 23:01:46.315662 4412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:46.315984 4412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:46.316105 4412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:46.323747 4412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:46.323886 4412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:46.324035 4412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:46.333880 4412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:39651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35227
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:46.335381 4412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:46.337339 4412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:46.351744 4420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:46.351878 4423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:46.351743 4419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:46.352849 4412 server_base.cc:1034] running on GCE node
I20260805 23:01:46.353516 4412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:46.354557 4412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:46.355772 4412 hybrid_clock.cc:648] HybridClock initialized: now 1785970906355722 us; error 47 us; skew 500 ppm
I20260805 23:01:46.356099 4412 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:01:46.358668 4412 webserver.cc:460] Webserver started at http://127.22.45.67:36381/ using document root <none> and password file <none>
I20260805 23:01:46.359516 4412 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:46.359630 4412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:46.359966 4412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:46.363294 4412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "2441a8a6222f485f81289d087c4d8d9c"
format_stamp: "Formatted at 2026-08-05 23:01:46 on dist-test-slave-1vmg"
server_key: "8dd767bc5a1cc4ee4600681ac6d79997"
server_key_iv: "0c2b54f54b1aff7f235753d25fce7cd6"
server_key_version: "encryptionkey@0"
I20260805 23:01:46.364152 4412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "2441a8a6222f485f81289d087c4d8d9c"
format_stamp: "Formatted at 2026-08-05 23:01:46 on dist-test-slave-1vmg"
server_key: "8dd767bc5a1cc4ee4600681ac6d79997"
server_key_iv: "0c2b54f54b1aff7f235753d25fce7cd6"
server_key_version: "encryptionkey@0"
I20260805 23:01:46.370039 4412 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:01:46.374161 4429 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:46.375897 4412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:01:46.376085 4412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "2441a8a6222f485f81289d087c4d8d9c"
format_stamp: "Formatted at 2026-08-05 23:01:46 on dist-test-slave-1vmg"
server_key: "8dd767bc5a1cc4ee4600681ac6d79997"
server_key_iv: "0c2b54f54b1aff7f235753d25fce7cd6"
server_key_version: "encryptionkey@0"
I20260805 23:01:46.376372 4412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:46.383229 4412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:46.384356 4412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:46.384670 4412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:46.385790 4412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:46.387528 4412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:46.387641 4412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:46.387768 4412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:46.387842 4412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:46.422730 4412 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:33283
I20260805 23:01:46.422776 4579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:33283 every 8 connection(s)
I20260805 23:01:46.424263 4412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:46.428695 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 4412
I20260805 23:01:46.428925 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:01:46.429486 22709 external_mini_cluster.cc:1428] Setting key a7fd4d967036eec46c2a4230ecfdb3bd
I20260805 23:01:46.433924 4239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:46.427166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:38767 (local address 127.22.45.126:35227)
0805 23:01:46.427387 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:46.427393 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:46.429173 (+ 1780us) server_negotiation.cc:407] Connection header received
0805 23:01:46.431603 (+ 2430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:46.431607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:46.431671 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:46.431760 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:46.433328 (+ 1568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:46.433332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:46.433335 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:46.433353 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:46.433388 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:46.433399 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:46.433492 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:46.433640 (+ 148us) server_negotiation.cc:299] Negotiation successful
0805 23:01:46.433697 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 23:01:46.435081 4582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:46.427780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35227 (local address 127.22.45.67:38767)
0805 23:01:46.428979 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:46.429032 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:46.431255 (+ 2223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:46.432035 (+ 780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:46.432044 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:46.432157 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:46.432971 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:01:46.432975 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:46.433031 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:01:46.433139 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:46.433476 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:46.433481 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:46.433487 (+ 6us) client_negotiation.cc:769] Sending connection context
0805 23:01:46.433718 (+ 231us) client_negotiation.cc:240] Negotiation successful
0805 23:01:46.433972 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":546,"thread_start_us":313,"threads_started":1}
I20260805 23:01:46.436735 4580 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35227
I20260805 23:01:46.437044 4580 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:46.437697 4580 heartbeater.cc:511] Master 127.22.45.126:35227 requested a full tablet report, sending...
I20260805 23:01:46.439508 3988 ts_manager.cc:194] Registered new tserver with Master: 2441a8a6222f485f81289d087c4d8d9c (127.22.45.67:33283)
I20260805 23:01:46.445551 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260805 23:01:46.452730 4239 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:01:46.450726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59224 (local address 127.22.45.126:35227)
0805 23:01:46.451010 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:46.451017 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:46.451481 (+ 464us) server_negotiation.cc:407] Connection header received
0805 23:01:46.451763 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:46.451769 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:46.451834 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:46.451940 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:46.452468 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59224: BlockingRecv error: recv got EOF from 127.0.0.1:59224 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
I20260805 23:01:46.453819 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 4067
I20260805 23:01:46.457525 4594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:46.455030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58364 (local address 127.22.45.65:46015)
0805 23:01:46.455616 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:46.455634 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:46.455664 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:01:46.455734 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:46.455740 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:46.455977 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:46.456111 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:46.456917 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:46.456924 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:46.456936 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:46.456954 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:46.456993 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:46.457006 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:46.457112 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:46.457164 (+ 52us) server_negotiation.cc:299] Negotiation successful
0805 23:01:46.457256 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":293,"threads_started":1}
I20260805 23:01:46.458828 4230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:46.541198 4237 heartbeater.cc:503] Master 127.22.45.126:35227 was elected leader, sending a full tablet report...
I20260805 23:01:46.543879 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 4067
I20260805 23:01:46.565464 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 4242
I20260805 23:01:46.569950 4596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:46.566522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56590 (local address 127.22.45.66:35543)
0805 23:01:46.567140 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:46.567149 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:46.567180 (+ 31us) server_negotiation.cc:407] Connection header received
0805 23:01:46.567248 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:46.567254 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:46.567506 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:46.567659 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:46.569118 (+ 1459us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:46.569127 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:46.569140 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:46.569166 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:46.569228 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:46.569245 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:46.569370 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:46.569533 (+ 163us) server_negotiation.cc:299] Negotiation successful
0805 23:01:46.569628 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":276,"threads_started":1}
I20260805 23:01:46.571408 4401 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:46.655323 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 4242
I20260805 23:01:46.676330 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 4412
I20260805 23:01:46.680604 4599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:46.677353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34290 (local address 127.22.45.67:33283)
0805 23:01:46.677976 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:46.677983 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:46.678020 (+ 37us) server_negotiation.cc:407] Connection header received
0805 23:01:46.678105 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:46.678116 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:46.678373 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:46.678550 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:46.679776 (+ 1226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:46.679783 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:46.679796 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:01:46.679810 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:46.679856 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:01:46.679872 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:46.680058 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:46.680136 (+ 78us) server_negotiation.cc:299] Negotiation successful
0805 23:01:46.680265 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":294,"threads_started":1}
I20260805 23:01:46.681986 4574 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:46.765475 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 4412
I20260805 23:01:46.789458 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 3949
I20260805 23:01:46.790771 4022 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:46.896494 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 3949
2026-08-05T23:01:46Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2613 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:01:47 dist-test-slave-1vmg krb5kdc[4605](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:01:47 dist-test-slave-1vmg krb5kdc[4605](info): set up 2 sockets
Aug 05 23:01:47 dist-test-slave-1vmg krb5kdc[4605](info): commencing operation
krb5kdc: starting...
W20260805 23:01:48.120285 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.001s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:01:48 dist-test-slave-1vmg krb5kdc[4605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:01:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:01:48.409871 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34497
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:34497
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:48.778887 4620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:48.779376 4620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:48.779523 4620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:48.787408 4620 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:01:48.787587 4620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:48.787678 4620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:48.787758 4620 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:01:48.787823 4620 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:01:48.798853 4620 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:34497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:48.800684 4620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:48.802237 4620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:48.815907 4627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:48.816008 4628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:48.816036 4630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:48.817502 4620 server_base.cc:1034] running on GCE node
I20260805 23:01:48.818487 4620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:48.820410 4620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:48.821770 4620 hybrid_clock.cc:648] HybridClock initialized: now 1785970908821705 us; error 65 us; skew 500 ppm
I20260805 23:01:48.822238 4620 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:48 dist-test-slave-1vmg krb5kdc[4605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970908, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:48.826324 4620 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:01:48.828361 4620 webserver.cc:460] Webserver started at http://127.22.45.126:36231/ using document root <none> and password file <none>
I20260805 23:01:48.829200 4620 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:48.829347 4620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:48.829696 4620 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:48.833185 4620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "7a48a6189ce74dc89f0922f1932f85dd"
format_stamp: "Formatted at 2026-08-05 23:01:48 on dist-test-slave-1vmg"
server_key: "1bdc7fbd935971377678e3e94201bbb9"
server_key_iv: "3de003dbe89b3b79b936834bbe253160"
server_key_version: "encryptionkey@0"
I20260805 23:01:48.834092 4620 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "7a48a6189ce74dc89f0922f1932f85dd"
format_stamp: "Formatted at 2026-08-05 23:01:48 on dist-test-slave-1vmg"
server_key: "1bdc7fbd935971377678e3e94201bbb9"
server_key_iv: "3de003dbe89b3b79b936834bbe253160"
server_key_version: "encryptionkey@0"
I20260805 23:01:48.841391 4620 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.003s
I20260805 23:01:48.846292 4641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:48.848560 4620 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260805 23:01:48.848894 4620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "7a48a6189ce74dc89f0922f1932f85dd"
format_stamp: "Formatted at 2026-08-05 23:01:48 on dist-test-slave-1vmg"
server_key: "1bdc7fbd935971377678e3e94201bbb9"
server_key_iv: "3de003dbe89b3b79b936834bbe253160"
server_key_version: "encryptionkey@0"
I20260805 23:01:48.849176 4620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:48.873492 4620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:48.878754 4620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:48.879118 4620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:48.900507 4620 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:34497
I20260805 23:01:48.900547 4711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:34497 every 8 connection(s)
I20260805 23:01:48.902110 4620 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:01:48.907434 4712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:48.912514 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 4620
I20260805 23:01:48.912806 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:01:48.913623 22709 external_mini_cluster.cc:1428] Setting key 31f65597b9735b1d5c52c9c3682b9193
I20260805 23:01:48.921659 4712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd: Bootstrap starting.
I20260805 23:01:48.926061 4712 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:48.927532 4712 log.cc:824] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:48.931779 4712 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd: No bootstrap required, opened a new log
Aug 05 23:01:48 dist-test-slave-1vmg krb5kdc[4605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:48.940881 4712 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a48a6189ce74dc89f0922f1932f85dd" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34497 } }
I20260805 23:01:48.941385 4712 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:48.941531 4712 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a48a6189ce74dc89f0922f1932f85dd, State: Initialized, Role: FOLLOWER
I20260805 23:01:48.942292 4712 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a48a6189ce74dc89f0922f1932f85dd" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34497 } }
I20260805 23:01:48.942457 4716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:48.916527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56714 (local address 127.22.45.126:34497)
0805 23:01:48.917489 (+ 962us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:48.917504 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:48.917555 (+ 51us) server_negotiation.cc:407] Connection header received
0805 23:01:48.919896 (+ 2341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:48.919930 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:48.920463 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:48.920864 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:48.923123 (+ 2259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:48.924596 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:48.926662 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:48.927868 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:48.928302 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:48.933413 (+ 5111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:48.933423 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:48.933443 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:48.933500 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:48.937342 (+ 3842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:48.938277 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:48.938287 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:48.938295 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:48.938501 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:48.938968 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:48.938972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:48.938974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:48.939710 (+ 736us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:48.940089 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:48.940586 (+ 497us) server_negotiation.cc:299] Negotiation successful
0805 23:01:48.941089 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":449,"threads_started":1}
I20260805 23:01:48.942562 4712 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:01:48.942728 4712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:01:48.942943 4712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:48.945554 4712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a48a6189ce74dc89f0922f1932f85dd" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34497 } }
I20260805 23:01:48.946237 4712 leader_election.cc:302] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a48a6189ce74dc89f0922f1932f85dd; no voters:
I20260805 23:01:48.946941 4712 leader_election.cc:288] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:01:48.947077 4719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:48.947777 4719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [term 1 LEADER]: Becoming Leader. State: Replica: 7a48a6189ce74dc89f0922f1932f85dd, State: Running, Role: LEADER
I20260805 23:01:48.948366 4719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a48a6189ce74dc89f0922f1932f85dd" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34497 } }
I20260805 23:01:48.949211 4712 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:01:48.951311 4720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a48a6189ce74dc89f0922f1932f85dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a48a6189ce74dc89f0922f1932f85dd" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34497 } } }
I20260805 23:01:48.951321 4721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a48a6189ce74dc89f0922f1932f85dd. Latest consensus state: current_term: 1 leader_uuid: "7a48a6189ce74dc89f0922f1932f85dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a48a6189ce74dc89f0922f1932f85dd" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34497 } } }
I20260805 23:01:48.952205 4721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:48.953696 4720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd [sys.catalog]: This master's current role is: LEADER
I20260805 23:01:48.954636 4728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:01:48.963737 4728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:01:48.976452 4728 catalog_manager.cc:1347] Generated new cluster ID: 45df631325764754ab3c001ff39785ba
I20260805 23:01:48.976601 4728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:01:49.007893 4728 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:01:49.010066 4728 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:01:49.019325 4728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd: Generated new TSK 0
I20260805 23:01:49.020608 4728 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:01:49.111678 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34497
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:49.479542 4744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:49.479938 4744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:49.480084 4744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:49.487963 4744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:49.488133 4744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:49.488297 4744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:01:49.499001 4744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:49.500564 4744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:49.502141 4744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:49.517781 4754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:49.517848 4753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:49.517819 4756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:49.519116 4744 server_base.cc:1034] running on GCE node
I20260805 23:01:49.519886 4744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:49.520998 4744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:49.522267 4744 hybrid_clock.cc:648] HybridClock initialized: now 1785970909522201 us; error 60 us; skew 500 ppm
I20260805 23:01:49.522621 4744 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:49 dist-test-slave-1vmg krb5kdc[4605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970909, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:49.526456 4744 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:01:49.528385 4744 webserver.cc:460] Webserver started at http://127.22.45.65:32813/ using document root <none> and password file <none>
I20260805 23:01:49.529217 4744 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:49.529356 4744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:49.529712 4744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:49.533216 4744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "a673d1301bcb4c9384846288b363f3b5"
format_stamp: "Formatted at 2026-08-05 23:01:49 on dist-test-slave-1vmg"
server_key: "38ced344e2103d8562e4263d22251e42"
server_key_iv: "e01c2cadfdd73642961b2e1474917233"
server_key_version: "encryptionkey@0"
I20260805 23:01:49.534113 4744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "a673d1301bcb4c9384846288b363f3b5"
format_stamp: "Formatted at 2026-08-05 23:01:49 on dist-test-slave-1vmg"
server_key: "38ced344e2103d8562e4263d22251e42"
server_key_iv: "e01c2cadfdd73642961b2e1474917233"
server_key_version: "encryptionkey@0"
I20260805 23:01:49.540926 4744 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:01:49.545382 4765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:49.547230 4744 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:01:49.547452 4744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "a673d1301bcb4c9384846288b363f3b5"
format_stamp: "Formatted at 2026-08-05 23:01:49 on dist-test-slave-1vmg"
server_key: "38ced344e2103d8562e4263d22251e42"
server_key_iv: "e01c2cadfdd73642961b2e1474917233"
server_key_version: "encryptionkey@0"
I20260805 23:01:49.547689 4744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:49.564460 4744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:49.569590 4744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:49.569944 4744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:49.571178 4744 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:49.572866 4744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:49.572963 4744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:49.573094 4744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:49.573153 4744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:49.608237 4744 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:33509
I20260805 23:01:49.608322 4920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:33509 every 8 connection(s)
I20260805 23:01:49.610145 4744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:01:49.614701 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 4744
I20260805 23:01:49.614984 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:01:49.615818 22709 external_mini_cluster.cc:1428] Setting key 12e4f96ec83a17af48ce0c17080f3468
Aug 05 23:01:49 dist-test-slave-1vmg krb5kdc[4605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970909, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:49.635265 4923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:49.613016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:36625 (local address 127.22.45.126:34497)
0805 23:01:49.613455 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:49.613460 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:49.614574 (+ 1114us) server_negotiation.cc:407] Connection header received
0805 23:01:49.617056 (+ 2482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:49.617063 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:49.617152 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:49.617258 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:49.619456 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:49.620254 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:49.622717 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:49.623214 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:49.623330 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:49.628184 (+ 4854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:49.628191 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:49.628195 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:49.628240 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:49.631548 (+ 3308us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:49.632546 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:49.632553 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:49.632557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:49.632751 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:49.633206 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:49.633211 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:49.633214 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:49.633607 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:49.633770 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:49.634593 (+ 823us) server_negotiation.cc:299] Negotiation successful
0805 23:01:49.634867 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":221,"threads_started":1}
I20260805 23:01:49.636178 4924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:49.613491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34497 (local address 127.22.45.65:36625)
0805 23:01:49.614354 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:49.614414 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:49.616754 (+ 2340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:49.617591 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:49.617606 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:49.618300 (+ 694us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:49.619212 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:49.619246 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:49.620460 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:49.620466 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:49.622464 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:49.622485 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:49.623482 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:49.623489 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:49.623808 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:49.624688 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:49.624720 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:49.627804 (+ 3084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:49.631805 (+ 4001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:49.631815 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:49.631832 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:49.632370 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:49.632861 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:49.632865 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:49.632867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:49.633083 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:49.633753 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:49.633761 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:49.634151 (+ 390us) client_negotiation.cc:769] Sending connection context
0805 23:01:49.634412 (+ 261us) client_negotiation.cc:240] Negotiation successful
0805 23:01:49.634876 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":323,"threads_started":1}
I20260805 23:01:49.638376 4921 heartbeater.cc:347] Connected to a master server at 127.22.45.126:34497
I20260805 23:01:49.638710 4921 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:49.639566 4921 heartbeater.cc:511] Master 127.22.45.126:34497 requested a full tablet report, sending...
I20260805 23:01:49.642139 4661 ts_manager.cc:194] Registered new tserver with Master: a673d1301bcb4c9384846288b363f3b5 (127.22.45.65:33509)
I20260805 23:01:49.643921 4661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:36625
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:01:49.686141 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34497
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:50.054504 4927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:50.054853 4927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:50.055032 4927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:50.063174 4927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:50.063335 4927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:50.063508 4927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:01:50.073581 4927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:50.075069 4927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:50.076411 4927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:01:50.091060 4938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:50.091270 4933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:50.091310 4935 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:50.092006 4927 server_base.cc:1034] running on GCE node
I20260805 23:01:50.092757 4927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:50.093811 4927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:50.095031 4927 hybrid_clock.cc:648] HybridClock initialized: now 1785970910094973 us; error 48 us; skew 500 ppm
I20260805 23:01:50.095371 4927 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:50 dist-test-slave-1vmg krb5kdc[4605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:50.098693 4927 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:01:50.100384 4927 webserver.cc:460] Webserver started at http://127.22.45.66:42699/ using document root <none> and password file <none>
I20260805 23:01:50.101162 4927 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:50.101292 4927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:50.101610 4927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:50.104924 4927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "53977ca2b53b404e9097c63fdb44c2c1"
format_stamp: "Formatted at 2026-08-05 23:01:50 on dist-test-slave-1vmg"
server_key: "526cc7fd9b0310210c5a62d6fe85b16a"
server_key_iv: "c93ed4e872dd0c60f9da47ba149805c0"
server_key_version: "encryptionkey@0"
I20260805 23:01:50.105829 4927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "53977ca2b53b404e9097c63fdb44c2c1"
format_stamp: "Formatted at 2026-08-05 23:01:50 on dist-test-slave-1vmg"
server_key: "526cc7fd9b0310210c5a62d6fe85b16a"
server_key_iv: "c93ed4e872dd0c60f9da47ba149805c0"
server_key_version: "encryptionkey@0"
I20260805 23:01:50.111965 4927 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:01:50.116155 4949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:50.117735 4927 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:01:50.117942 4927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "53977ca2b53b404e9097c63fdb44c2c1"
format_stamp: "Formatted at 2026-08-05 23:01:50 on dist-test-slave-1vmg"
server_key: "526cc7fd9b0310210c5a62d6fe85b16a"
server_key_iv: "c93ed4e872dd0c60f9da47ba149805c0"
server_key_version: "encryptionkey@0"
I20260805 23:01:50.118183 4927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:50.134873 4927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:50.139791 4927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:50.140103 4927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:50.141161 4927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:50.142702 4927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:50.142787 4927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:50.142951 4927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:50.143013 4927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260805 23:01:50.174394 4927 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:33247
I20260805 23:01:50.174446 5110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:33247 every 8 connection(s)
I20260805 23:01:50.175864 4927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:01:50.176324 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 4927
I20260805 23:01:50.176517 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:01:50.177062 22709 external_mini_cluster.cc:1428] Setting key 7846edd7b1293a0b267048fcd4af9b40
Aug 05 23:01:50 dist-test-slave-1vmg krb5kdc[4605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:50.200832 5115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.178718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:40433 (local address 127.22.45.126:34497)
0805 23:01:50.179261 (+ 543us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:50.179268 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:50.180532 (+ 1264us) server_negotiation.cc:407] Connection header received
0805 23:01:50.183151 (+ 2619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:50.183155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:50.183257 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:50.183356 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:50.185593 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.186362 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.188705 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.189252 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.189384 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.194015 (+ 4631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:50.194023 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:50.194028 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:50.194076 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:50.197392 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:50.198278 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:50.198284 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:50.198287 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:50.198466 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:50.198888 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:50.198892 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:50.198895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:50.199297 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:50.199441 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:50.200232 (+ 791us) server_negotiation.cc:299] Negotiation successful
0805 23:01:50.200471 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":281,"threads_started":1}
I20260805 23:01:50.201939 5116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.179373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34497 (local address 127.22.45.66:40433)
0805 23:01:50.180315 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:50.180384 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:50.182769 (+ 2385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:50.183679 (+ 910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:50.183692 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:50.184496 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:50.185388 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.185416 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.186556 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.186562 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.188498 (+ 1936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.188519 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.189533 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.189540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.189873 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.190687 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:50.190720 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:50.193680 (+ 2960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:50.197576 (+ 3896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:50.197584 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:50.197602 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:50.198111 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:50.198566 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:50.198569 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:50.198571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:50.198773 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:50.199415 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:50.199421 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:50.199830 (+ 409us) client_negotiation.cc:769] Sending connection context
0805 23:01:50.200085 (+ 255us) client_negotiation.cc:240] Negotiation successful
0805 23:01:50.200713 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":347,"threads_started":1}
I20260805 23:01:50.203581 5112 heartbeater.cc:347] Connected to a master server at 127.22.45.126:34497
I20260805 23:01:50.203890 5112 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:50.204689 5112 heartbeater.cc:511] Master 127.22.45.126:34497 requested a full tablet report, sending...
I20260805 23:01:50.206342 4661 ts_manager.cc:194] Registered new tserver with Master: 53977ca2b53b404e9097c63fdb44c2c1 (127.22.45.66:33247)
I20260805 23:01:50.207280 4661 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:40433
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:01:50.242434 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34497
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:01:50.613372 5119 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:01:50.613826 5119 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:01:50.613993 5119 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:01:50.622308 5119 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:01:50.622470 5119 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:01:50.622615 5119 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:01:50.633067 5119 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:01:50.634488 5119 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:01:50.636132 5119 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 23:01:50.647735 4921 heartbeater.cc:503] Master 127.22.45.126:34497 was elected leader, sending a full tablet report...
W20260805 23:01:50.652706 5127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:50.652662 5131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:01:50.652762 5129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:01:50.657147 5119 server_base.cc:1034] running on GCE node
I20260805 23:01:50.657982 5119 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:01:50.659175 5119 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:01:50.660468 5119 hybrid_clock.cc:648] HybridClock initialized: now 1785970910660386 us; error 50 us; skew 500 ppm
I20260805 23:01:50.661118 5119 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:01:50 dist-test-slave-1vmg krb5kdc[4605](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:01:50.665373 5119 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:01:50.667279 5119 webserver.cc:460] Webserver started at http://127.22.45.67:45925/ using document root <none> and password file <none>
I20260805 23:01:50.668063 5119 fs_manager.cc:359] Metadata directory not provided
I20260805 23:01:50.668177 5119 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:01:50.668459 5119 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:01:50.671931 5119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "fc2998257cf94b41ba69cee4f0d9cb2d"
format_stamp: "Formatted at 2026-08-05 23:01:50 on dist-test-slave-1vmg"
server_key: "f87466a01c77ef48477009742b61a49f"
server_key_iv: "23ede80ba57ef4fe31546962ffa93aa6"
server_key_version: "encryptionkey@0"
I20260805 23:01:50.672770 5119 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "fc2998257cf94b41ba69cee4f0d9cb2d"
format_stamp: "Formatted at 2026-08-05 23:01:50 on dist-test-slave-1vmg"
server_key: "f87466a01c77ef48477009742b61a49f"
server_key_iv: "23ede80ba57ef4fe31546962ffa93aa6"
server_key_version: "encryptionkey@0"
I20260805 23:01:50.678500 5119 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 23:01:50.682178 5138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:50.683739 5119 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:01:50.683902 5119 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "fc2998257cf94b41ba69cee4f0d9cb2d"
format_stamp: "Formatted at 2026-08-05 23:01:50 on dist-test-slave-1vmg"
server_key: "f87466a01c77ef48477009742b61a49f"
server_key_iv: "23ede80ba57ef4fe31546962ffa93aa6"
server_key_version: "encryptionkey@0"
I20260805 23:01:50.684089 5119 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:01:50.701458 5119 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:01:50.707211 5119 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:01:50.707607 5119 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:01:50.708689 5119 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:01:50.710220 5119 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:01:50.710301 5119 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:50.710392 5119 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:01:50.710440 5119 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:01:50.745456 5119 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:37685
I20260805 23:01:50.745504 5296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:37685 every 8 connection(s)
I20260805 23:01:50.746956 5119 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:01:50.754760 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 5119
I20260805 23:01:50.754988 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:01:50.755448 22709 external_mini_cluster.cc:1428] Setting key d25e4c8a365dc5626d5a235e014b8eb5
Aug 05 23:01:50 dist-test-slave-1vmg krb5kdc[4605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:01:50.768621 5299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.749644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:54829 (local address 127.22.45.126:34497)
0805 23:01:50.750159 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:50.750170 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:50.751285 (+ 1115us) server_negotiation.cc:407] Connection header received
0805 23:01:50.753265 (+ 1980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:50.753270 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:50.753356 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:50.753466 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:50.755257 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.756064 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.757804 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.758227 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.758342 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.761998 (+ 3656us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:50.762004 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:50.762007 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:50.762044 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:50.764988 (+ 2944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:50.765937 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:50.765942 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:50.765945 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:50.766097 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:50.766583 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:50.766587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:50.766589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:50.766895 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:50.767115 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:50.767934 (+ 819us) server_negotiation.cc:299] Negotiation successful
0805 23:01:50.768217 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":214,"threads_started":1}
I20260805 23:01:50.769641 5300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.750289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34497 (local address 127.22.45.67:54829)
0805 23:01:50.751117 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:50.751160 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:50.752949 (+ 1789us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:50.753696 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:50.753705 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:50.754358 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:01:50.755036 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.755062 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.756239 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.756243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.757629 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.757642 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.758450 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.758457 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.758692 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.759370 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:01:50.759394 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:01:50.761756 (+ 2362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:01:50.765226 (+ 3470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:50.765236 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:50.765254 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:50.765781 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:50.766216 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:01:50.766221 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:01:50.766225 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:01:50.766449 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:01:50.767085 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:01:50.767095 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:01:50.767504 (+ 409us) client_negotiation.cc:769] Sending connection context
0805 23:01:50.767786 (+ 282us) client_negotiation.cc:240] Negotiation successful
0805 23:01:50.768396 (+ 610us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":322,"threads_started":1}
I20260805 23:01:50.771209 5297 heartbeater.cc:347] Connected to a master server at 127.22.45.126:34497
I20260805 23:01:50.771543 5297 heartbeater.cc:464] Registering TS with master...
I20260805 23:01:50.772361 5297 heartbeater.cc:511] Master 127.22.45.126:34497 requested a full tablet report, sending...
I20260805 23:01:50.774070 4659 ts_manager.cc:194] Registered new tserver with Master: fc2998257cf94b41ba69cee4f0d9cb2d (127.22.45.67:37685)
I20260805 23:01:50.775144 4659 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:54829
I20260805 23:01:50.784052 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:01:50.801743 5299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.788859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56728 (local address 127.22.45.126:34497)
0805 23:01:50.789030 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:50.789035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:50.789606 (+ 571us) server_negotiation.cc:407] Connection header received
0805 23:01:50.789761 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:50.789765 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:50.789837 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:50.789930 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:50.791528 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.792323 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.793593 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.794017 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.794155 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.796530 (+ 2375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:50.796535 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:50.796539 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:50.796578 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:50.799153 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:50.799933 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:50.799937 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:50.799939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:50.800088 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:50.800413 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:50.800417 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:50.800419 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:50.800789 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:50.800991 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:50.801277 (+ 286us) server_negotiation.cc:299] Negotiation successful
0805 23:01:50.801480 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260805 23:01:50.806784 4659 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56728:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:01:50.814015 4659 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:01:50.840643 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.827126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60304 (local address 127.22.45.66:33247)
0805 23:01:50.828387 (+ 1261us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:50.828396 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:50.829065 (+ 669us) server_negotiation.cc:407] Connection header received
0805 23:01:50.830158 (+ 1093us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:50.830168 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:50.830443 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:50.830624 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:50.831722 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.833551 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.836808 (+ 3257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.838587 (+ 1779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.838776 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.839071 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:50.840060 (+ 989us) server_negotiation.cc:299] Negotiation successful
0805 23:01:50.840265 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1090,"thread_start_us":959,"threads_started":1}
I20260805 23:01:50.841445 5324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.827074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:33247 (local address 127.0.0.1:60304)
0805 23:01:50.828922 (+ 1848us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:50.828960 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:50.829959 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:50.831011 (+ 1052us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:50.831020 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:50.831062 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:50.831502 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.831514 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.833792 (+ 2278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.833798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.836532 (+ 2734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.836554 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.839331 (+ 2777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.839338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.839649 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.839755 (+ 106us) client_negotiation.cc:769] Sending connection context
0805 23:01:50.840831 (+ 1076us) client_negotiation.cc:240] Negotiation successful
0805 23:01:50.841066 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1593,"thread_start_us":1609,"threads_started":1}
I20260805 23:01:50.846004 5019 tablet_service.cc:1467] Processing CreateTablet for tablet 6c4a20ab37834c74a89a7e371143dfe3 (DEFAULT_TABLE table=test-table [id=21bea8ebaf6249509d0ba5376660e026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:50.847679 5019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c4a20ab37834c74a89a7e371143dfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:50.848909 5323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.827116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:37685 (local address 127.0.0.1:43182)
0805 23:01:50.829524 (+ 2408us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:50.829542 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:50.829745 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:50.841992 (+ 12247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:50.841996 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:50.842018 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:50.842317 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.842325 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.844389 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.844395 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.846461 (+ 2066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.846472 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.848089 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.848096 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.848257 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.848292 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:01:50.848374 (+ 82us) client_negotiation.cc:240] Negotiation successful
0805 23:01:50.848530 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2279,"thread_start_us":2116,"threads_started":1}
I20260805 23:01:50.849478 5328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.828102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33509 (local address 127.0.0.1:44828)
0805 23:01:50.838380 (+ 10278us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:50.838408 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:50.838683 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:50.841291 (+ 2608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:50.841296 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:50.841327 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:50.841754 (+ 427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.841767 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.843898 (+ 2131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.843903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.846198 (+ 2295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:50.846217 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.848427 (+ 2210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.848434 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:50.848613 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.848647 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 23:01:50.848744 (+ 97us) client_negotiation.cc:240] Negotiation successful
0805 23:01:50.848881 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10081,"mutex_wait_us":5,"thread_start_us":10879,"threads_started":1}
I20260805 23:01:50.849834 5326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.827799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43182 (local address 127.22.45.67:37685)
0805 23:01:50.841117 (+ 13318us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:50.841123 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:50.841150 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:01:50.841248 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:50.841255 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:50.841461 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:50.842473 (+ 1012us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:50.842681 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.844206 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.846619 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.847853 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.849011 (+ 1158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.849245 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:50.849327 (+ 82us) server_negotiation.cc:299] Negotiation successful
0805 23:01:50.849504 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13171,"thread_start_us":12766,"threads_started":1}
I20260805 23:01:50.850399 5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:50.828472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44828 (local address 127.22.45.65:33509)
0805 23:01:50.840425 (+ 11953us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:50.840434 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:50.840468 (+ 34us) server_negotiation.cc:407] Connection header received
0805 23:01:50.840585 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:50.840593 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:50.841030 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:50.841298 (+ 268us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:50.842126 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.843730 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.846402 (+ 2672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:50.847870 (+ 1468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:50.848009 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:50.848258 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:50.849065 (+ 807us) server_negotiation.cc:299] Negotiation successful
0805 23:01:50.850039 (+ 974us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11753,"thread_start_us":11555,"threads_started":1}
I20260805 23:01:50.853901 5210 tablet_service.cc:1467] Processing CreateTablet for tablet 6c4a20ab37834c74a89a7e371143dfe3 (DEFAULT_TABLE table=test-table [id=21bea8ebaf6249509d0ba5376660e026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:50.853901 4841 tablet_service.cc:1467] Processing CreateTablet for tablet 6c4a20ab37834c74a89a7e371143dfe3 (DEFAULT_TABLE table=test-table [id=21bea8ebaf6249509d0ba5376660e026]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:01:50.855507 5210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c4a20ab37834c74a89a7e371143dfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:50.855505 4841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c4a20ab37834c74a89a7e371143dfe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:01:50.861212 5331 tablet_bootstrap.cc:492] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Bootstrap starting.
I20260805 23:01:50.864782 5331 tablet_bootstrap.cc:654] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:50.865931 5331 log.cc:824] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:50.870666 5331 tablet_bootstrap.cc:492] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: No bootstrap required, opened a new log
I20260805 23:01:50.871155 5331 ts_tablet_manager.cc:1397] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.004s
I20260805 23:01:50.871188 5334 tablet_bootstrap.cc:492] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Bootstrap starting.
I20260805 23:01:50.874990 5334 tablet_bootstrap.cc:654] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:50.875767 5335 tablet_bootstrap.cc:492] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Bootstrap starting.
I20260805 23:01:50.877060 5334 log.cc:824] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:50.880026 5335 tablet_bootstrap.cc:654] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Neither blocks nor log segments found. Creating new log.
I20260805 23:01:50.880890 5334 tablet_bootstrap.cc:492] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: No bootstrap required, opened a new log
I20260805 23:01:50.881119 5335 log.cc:824] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:01:50.881206 5334 ts_tablet_manager.cc:1397] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260805 23:01:50.882238 5331 raft_consensus.cc:348] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:50.882740 5331 raft_consensus.cc:374] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:50.882900 5331 raft_consensus.cc:729] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53977ca2b53b404e9097c63fdb44c2c1, State: Initialized, Role: FOLLOWER
I20260805 23:01:50.883612 5331 consensus_queue.cc:260] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:50.884160 5335 tablet_bootstrap.cc:492] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: No bootstrap required, opened a new log
I20260805 23:01:50.884524 5335 ts_tablet_manager.cc:1397] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260805 23:01:50.884845 5112 heartbeater.cc:503] Master 127.22.45.126:34497 was elected leader, sending a full tablet report...
I20260805 23:01:50.885519 5331 ts_tablet_manager.cc:1428] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Time spent starting tablet: real 0.014s user 0.005s sys 0.007s
I20260805 23:01:50.892215 5334 raft_consensus.cc:348] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:50.892765 5334 raft_consensus.cc:374] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:50.892874 5334 raft_consensus.cc:729] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a673d1301bcb4c9384846288b363f3b5, State: Initialized, Role: FOLLOWER
I20260805 23:01:50.893573 5334 consensus_queue.cc:260] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:50.895555 5334 ts_tablet_manager.cc:1428] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Time spent starting tablet: real 0.014s user 0.012s sys 0.001s
I20260805 23:01:50.896485 5335 raft_consensus.cc:348] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:50.896970 5335 raft_consensus.cc:374] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:01:50.897081 5335 raft_consensus.cc:729] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc2998257cf94b41ba69cee4f0d9cb2d, State: Initialized, Role: FOLLOWER
I20260805 23:01:50.897738 5335 consensus_queue.cc:260] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:50.899122 5297 heartbeater.cc:503] Master 127.22.45.126:34497 was elected leader, sending a full tablet report...
I20260805 23:01:50.899811 5335 ts_tablet_manager.cc:1428] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
W20260805 23:01:50.928241 5114 tablet.cc:2369] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:01:50.998766 5298 tablet.cc:2369] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:51.062672 5338 raft_consensus.cc:482] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:01:51.063097 5338 raft_consensus.cc:504] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:51.065011 5338 leader_election.cc:288] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc2998257cf94b41ba69cee4f0d9cb2d (127.22.45.67:37685), a673d1301bcb4c9384846288b363f3b5 (127.22.45.65:33509)
I20260805 23:01:51.074548 5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.065538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:35061 (local address 127.22.45.65:33509)
0805 23:01:51.065767 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:51.065774 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:51.066609 (+ 835us) server_negotiation.cc:407] Connection header received
0805 23:01:51.066823 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:51.066829 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:51.066909 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:51.067010 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:51.067689 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.068785 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.071973 (+ 3188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.073217 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.073417 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.073541 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:51.074111 (+ 570us) server_negotiation.cc:299] Negotiation successful
0805 23:01:51.074274 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 23:01:51.074612 5326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.065642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:46347 (local address 127.22.45.67:37685)
0805 23:01:51.065876 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:51.065882 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:51.066863 (+ 981us) server_negotiation.cc:407] Connection header received
0805 23:01:51.067059 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:51.067065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:51.067140 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:51.067223 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:01:51.067903 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.068979 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.071973 (+ 2994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.073227 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.073423 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.073501 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:51.074246 (+ 745us) server_negotiation.cc:299] Negotiation successful
0805 23:01:51.074386 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 23:01:51.075385 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.065555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:33509 (local address 127.22.45.66:35061)
0805 23:01:51.066464 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:51.066488 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:51.066671 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:51.067038 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:51.067044 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:51.067072 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:51.067495 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:51.067510 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.068957 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.068962 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:51.071762 (+ 2800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:51.071785 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.073684 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.073692 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:51.073877 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.073916 (+ 39us) client_negotiation.cc:769] Sending connection context
0805 23:01:51.074697 (+ 781us) client_negotiation.cc:240] Negotiation successful
0805 23:01:51.074871 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":100,"thread_start_us":447,"threads_started":1}
I20260805 23:01:51.075489 5346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.065738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:37685 (local address 127.22.45.66:46347)
0805 23:01:51.066730 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0805 23:01:51.066748 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:01:51.066889 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:01:51.067265 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:01:51.067270 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:01:51.067293 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:01:51.067756 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:51.067766 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.069121 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.069127 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:51.071762 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:01:51.071785 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.073865 (+ 2080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.073872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:01:51.074051 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.074097 (+ 46us) client_negotiation.cc:769] Sending connection context
0805 23:01:51.074891 (+ 794us) client_negotiation.cc:240] Negotiation successful
0805 23:01:51.075079 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"mutex_wait_us":57,"thread_start_us":594,"threads_started":1}
I20260805 23:01:51.076642 5234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4a20ab37834c74a89a7e371143dfe3" candidate_uuid: "53977ca2b53b404e9097c63fdb44c2c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" is_pre_election: true
I20260805 23:01:51.076643 4864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4a20ab37834c74a89a7e371143dfe3" candidate_uuid: "53977ca2b53b404e9097c63fdb44c2c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a673d1301bcb4c9384846288b363f3b5" is_pre_election: true
I20260805 23:01:51.077195 5234 raft_consensus.cc:2454] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53977ca2b53b404e9097c63fdb44c2c1 in term 0.
I20260805 23:01:51.077188 4864 raft_consensus.cc:2454] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53977ca2b53b404e9097c63fdb44c2c1 in term 0.
I20260805 23:01:51.077903 4953 leader_election.cc:302] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53977ca2b53b404e9097c63fdb44c2c1, fc2998257cf94b41ba69cee4f0d9cb2d; no voters:
I20260805 23:01:51.078306 5338 raft_consensus.cc:2781] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:01:51.078440 5338 raft_consensus.cc:482] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:01:51.078533 5338 raft_consensus.cc:3037] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:51.080873 5338 raft_consensus.cc:504] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:51.081537 5338 leader_election.cc:288] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [CANDIDATE]: Term 1 election: Requested vote from peers fc2998257cf94b41ba69cee4f0d9cb2d (127.22.45.67:37685), a673d1301bcb4c9384846288b363f3b5 (127.22.45.65:33509)
I20260805 23:01:51.082114 4864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4a20ab37834c74a89a7e371143dfe3" candidate_uuid: "53977ca2b53b404e9097c63fdb44c2c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a673d1301bcb4c9384846288b363f3b5"
I20260805 23:01:51.082118 5234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c4a20ab37834c74a89a7e371143dfe3" candidate_uuid: "53977ca2b53b404e9097c63fdb44c2c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d"
I20260805 23:01:51.082317 5234 raft_consensus.cc:3037] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:51.082324 4864 raft_consensus.cc:3037] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:01:51.084780 4864 raft_consensus.cc:2454] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53977ca2b53b404e9097c63fdb44c2c1 in term 1.
I20260805 23:01:51.084779 5234 raft_consensus.cc:2454] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53977ca2b53b404e9097c63fdb44c2c1 in term 1.
I20260805 23:01:51.085374 4955 leader_election.cc:302] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 53977ca2b53b404e9097c63fdb44c2c1, a673d1301bcb4c9384846288b363f3b5, fc2998257cf94b41ba69cee4f0d9cb2d; no voters:
I20260805 23:01:51.085770 5338 raft_consensus.cc:2781] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:01:51.086285 5338 raft_consensus.cc:686] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 1 LEADER]: Becoming Leader. State: Replica: 53977ca2b53b404e9097c63fdb44c2c1, State: Running, Role: LEADER
I20260805 23:01:51.086982 5338 consensus_queue.cc:237] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } }
I20260805 23:01:51.093305 4661 catalog_manager.cc:5495] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53977ca2b53b404e9097c63fdb44c2c1 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "53977ca2b53b404e9097c63fdb44c2c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53977ca2b53b404e9097c63fdb44c2c1" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 33247 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 } health_report { overall_health: UNKNOWN } } }
W20260805 23:01:51.113144 4922 tablet.cc:2369] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:01:51.146656 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.141009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.22.45.66:33247)
0805 23:01:51.141258 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:51.141263 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:51.141284 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:01:51.141461 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:51.141465 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:51.141558 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:51.141699 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:01:51.142042 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.142840 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.144265 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.144707 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.144826 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.145337 (+ 511us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:01:51.145908 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:01:51.146050 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:51.146239 (+ 189us) server_negotiation.cc:299] Negotiation successful
0805 23:01:51.146345 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260805 23:01:51.156569 5234 raft_consensus.cc:1261] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 1 FOLLOWER]: Refusing update from remote peer 53977ca2b53b404e9097c63fdb44c2c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:51.156569 4864 raft_consensus.cc:1261] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 1 FOLLOWER]: Refusing update from remote peer 53977ca2b53b404e9097c63fdb44c2c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:01:51.157819 5347 consensus_queue.cc:1035] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc2998257cf94b41ba69cee4f0d9cb2d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 37685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:51.158310 5338 consensus_queue.cc:1035] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a673d1301bcb4c9384846288b363f3b5" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 33509 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:01:51.171152 5352 mvcc.cc:205] Tried to move back new op lower bound from 7315336852085002240 to 7315336851817693184. Current Snapshot: MvccSnapshot[applied={T|T < 7315336852085002240}]
I20260805 23:01:51.172623 5350 mvcc.cc:205] Tried to move back new op lower bound from 7315336852085002240 to 7315336851817693184. Current Snapshot: MvccSnapshot[applied={T|T < 7315336852085002240}]
I20260805 23:01:51.187229 5351 mvcc.cc:205] Tried to move back new op lower bound from 7315336852085002240 to 7315336851817693184. Current Snapshot: MvccSnapshot[applied={T|T < 7315336852085002240}]
I20260805 23:01:51.194885 4661 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:51.195233 4661 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56728:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:01:51.199859 4661 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7a48a6189ce74dc89f0922f1932f85dd: Sending DeleteTablet for 3 replicas of tablet 6c4a20ab37834c74a89a7e371143dfe3
I20260805 23:01:51.201241 5210 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c4a20ab37834c74a89a7e371143dfe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:51 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:43182
I20260805 23:01:51.201282 5019 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c4a20ab37834c74a89a7e371143dfe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:51 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:60304
I20260805 23:01:51.206394 4841 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c4a20ab37834c74a89a7e371143dfe3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:01:51 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:44828
I20260805 23:01:51.209755 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 4744
I20260805 23:01:51.214275 5362 tablet_replica.cc:330] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: stopping tablet replica
I20260805 23:01:51.214936 5362 raft_consensus.cc:2229] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:51.215636 5362 raft_consensus.cc:2258] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:51.216770 5363 tablet_replica.cc:330] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: stopping tablet replica
I20260805 23:01:51.217195 5364 tablet_replica.cc:330] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: stopping tablet replica
I20260805 23:01:51.217497 5363 raft_consensus.cc:2229] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:01:51.217614 5364 raft_consensus.cc:2229] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:01:51.218223 5364 raft_consensus.cc:2258] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:51.218503 5363 raft_consensus.cc:2258] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:01:51.220965 5363 ts_tablet_manager.cc:1905] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:51.220959 5364 ts_tablet_manager.cc:1905] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:51.224545 5362 ts_tablet_manager.cc:1905] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:01:51.229558 5363 ts_tablet_manager.cc:1918] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:51.229939 5363 log.cc:1196] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/6c4a20ab37834c74a89a7e371143dfe3
I20260805 23:01:51.230674 5363 ts_tablet_manager.cc:1939] T 6c4a20ab37834c74a89a7e371143dfe3 P 53977ca2b53b404e9097c63fdb44c2c1: Deleting consensus metadata
I20260805 23:01:51.232312 5362 ts_tablet_manager.cc:1918] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:51.232520 5362 log.cc:1196] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/6c4a20ab37834c74a89a7e371143dfe3
I20260805 23:01:51.233098 5362 ts_tablet_manager.cc:1939] T 6c4a20ab37834c74a89a7e371143dfe3 P fc2998257cf94b41ba69cee4f0d9cb2d: Deleting consensus metadata
I20260805 23:01:51.233742 4642 catalog_manager.cc:4841] TS 53977ca2b53b404e9097c63fdb44c2c1 (127.22.45.66:33247): tablet 6c4a20ab37834c74a89a7e371143dfe3 (table test-table [id=21bea8ebaf6249509d0ba5376660e026]) successfully deleted
I20260805 23:01:51.235298 4643 catalog_manager.cc:4841] TS fc2998257cf94b41ba69cee4f0d9cb2d (127.22.45.67:37685): tablet 6c4a20ab37834c74a89a7e371143dfe3 (table test-table [id=21bea8ebaf6249509d0ba5376660e026]) successfully deleted
Aug 05 23:01:51 dist-test-slave-1vmg krb5kdc[4605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:01:51.243080 5364 ts_tablet_manager.cc:1918] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:01:51.243348 5364 log.cc:1196] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/6c4a20ab37834c74a89a7e371143dfe3
I20260805 23:01:51.243989 5364 ts_tablet_manager.cc:1939] T 6c4a20ab37834c74a89a7e371143dfe3 P a673d1301bcb4c9384846288b363f3b5: Deleting consensus metadata
I20260805 23:01:51.246058 4646 catalog_manager.cc:4841] TS a673d1301bcb4c9384846288b363f3b5 (127.22.45.65:33509): tablet 6c4a20ab37834c74a89a7e371143dfe3 (table test-table [id=21bea8ebaf6249509d0ba5376660e026]) successfully deleted
I20260805 23:01:51.248908 5329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.211646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44840 (local address 127.22.45.65:33509)
0805 23:01:51.211855 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:51.211862 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:51.224387 (+ 12525us) server_negotiation.cc:407] Connection header received
0805 23:01:51.224943 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:51.224950 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:51.225051 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:51.225145 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:51.227243 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.228428 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.230448 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.231166 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.231306 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.238001 (+ 6695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:51.238025 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:51.238056 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:51.238216 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:51.243804 (+ 5588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:51.245296 (+ 1492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:51.245306 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:51.245310 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:51.245536 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:51.246438 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:51.246445 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:51.246449 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:51.247373 (+ 924us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:51.247801 (+ 428us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:51.248208 (+ 407us) server_negotiation.cc:299] Negotiation successful
0805 23:01:51.248516 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 23:01:51.249878 4916 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:51.405550 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 4744
I20260805 23:01:51.434654 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 4927
Aug 05 23:01:51 dist-test-slave-1vmg krb5kdc[4605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:01:51.452374 5325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.435693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60322 (local address 127.22.45.66:33247)
0805 23:01:51.435898 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:51.435904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:51.435924 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:01:51.435997 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:51.436000 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:51.436070 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:51.436157 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:51.437485 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.438319 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.439743 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.440252 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.440378 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.445143 (+ 4765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:51.445164 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:51.445181 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:51.445224 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:51.448819 (+ 3595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:51.449787 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:51.449796 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:51.449798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:51.449978 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:51.450453 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:51.450458 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:51.450461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:51.450982 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:51.451393 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:51.451701 (+ 308us) server_negotiation.cc:299] Negotiation successful
0805 23:01:51.451960 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 23:01:51.453171 5103 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:51.575110 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 4927
I20260805 23:01:51.598345 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 5119
Aug 05 23:01:51 dist-test-slave-1vmg krb5kdc[4605](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:01:51.616506 5371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:01:51.599176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43192 (local address 127.22.45.67:37685)
0805 23:01:51.599638 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0805 23:01:51.599643 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:01:51.599661 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:01:51.599720 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:01:51.599743 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:01:51.599817 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:01:51.599913 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:01:51.601274 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.602026 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.603472 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:01:51.603923 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:01:51.604042 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:01:51.608935 (+ 4893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:01:51.608956 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:01:51.608974 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:01:51.609044 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:01:51.612308 (+ 3264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:51.613329 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:51.613339 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:51.613341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:51.613569 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:01:51.614097 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:01:51.614102 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:01:51.614104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:01:51.614569 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:01:51.615202 (+ 633us) server_negotiation.cc:1035] Waiting for connection context
0805 23:01:51.615666 (+ 464us) server_negotiation.cc:299] Negotiation successful
0805 23:01:51.616168 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":361,"thread_start_us":251,"threads_started":1}
I20260805 23:01:51.617293 5289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:51.709861 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 5119
I20260805 23:01:51.730680 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 4620
I20260805 23:01:51.731956 4706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:01:51.843232 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 4620
2026-08-05T23:01:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4945 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:01:51 dist-test-slave-1vmg krb5kdc[5377](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:01:51 dist-test-slave-1vmg krb5kdc[5377](info): set up 2 sockets
Aug 05 23:01:51 dist-test-slave-1vmg krb5kdc[5377](info): commencing operation
krb5kdc: starting...
W20260805 23:01:53.059297 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.004s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:01:53 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:01:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:01:53Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/rangeradmin_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/rangeradmin_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/rangerlookup_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/rangerlookup_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
I20260805 23:01:53.515466 22709 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNZyF8v/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/postgres -l logfile start
2026-08-05 23:01:56.346 UTC [5423] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 23:01:56.346 UTC [5423] LOG: listening on IPv4 address "127.22.45.84", port 51741
2026-08-05 23:01:56.350 UTC [5423] LOG: listening on Unix socket "/tmp/.s.PGSQL.51741"
2026-08-05 23:01:56.374 UTC [5426] LOG: database system was shut down at 2026-08-05 23:01:54 UTC
2026-08-05 23:01:56.378 UTC [5423] LOG: database system is ready to accept connections
I20260805 23:01:57.445873 22709 mini_postgres.cc:96] Postgres bound to 51741
2026-08-05 23:01:57.470 UTC [5437] FATAL: database "slave" does not exist
127.22.45.84:51741 - accepting connections
I20260805 23:01:57.471184 22709 mini_ranger.cc:161] Starting Ranger...
I20260805 23:01:57.506294 22709 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 23:01:58.124332 22709 mini_ranger.cc:87] Created ranger Postgres database
I20260805 23:01:58.124471 22709 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-admin
2026-08-05 23:01:58,468 [I] DB FLAVOR :POSTGRES
2026-08-05 23:01:58,468 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 23:01:58,468 [I] Checking connection..
2026-08-05 23:01:58,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 23:01:58,767 [I] Checking connection passed.
2026-08-05 23:01:58,767 [I] --------- Verifying version history table ---------
2026-08-05 23:01:58,767 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 23:01:59,045 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 23:01:59,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 23:01:59,340 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 23:01:59,340 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 23:01:59,340 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 23:01:59.617 UTC [5534] WARNING: there is no transaction in progress
2026-08-05 23:01:59,626 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 23:01:59,627 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 23:01:59,916 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 23:01:59,917 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 23:01:59,917 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 23:02:00,203 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 23:02:00,477 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1vmg.c.gcp-upstream.internal','N') ;"
2026-08-05 23:02:00,755 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 23:02:01,050 [I] Table x_portal_user does not exist in database ranger
2026-08-05 23:02:01,050 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 23:02:01,333 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 23:02:01,334 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 23:02:01,595 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 23:02:01,895 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 23:02:01,895 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 23:02:03.031 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.050 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.068 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.086 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.104 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.125 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.192 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.201 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.219 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.232 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.243 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.260 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.272 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.279 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.287 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:03.295 UTC [5674] WARNING: there is no transaction in progress
2026-08-05 23:02:04,082 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 23:02:04,083 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 23:02:04,349 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 23:02:04,350 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 23:02:04,620 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 23:02:04,620 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 23:02:04,906 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 23:02:04,906 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 23:02:05,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 23:02:05,466 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1vmg.c.gcp-upstream.internal';"
2026-08-05 23:02:05,742 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 23:02:05,743 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 23:02:06,029 [I] DB_PATCHES have already been applied
I20260805 23:02:06.035852 22709 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNZyF8v/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 23:02:06.035956 22709 mini_ranger.cc:193] Using host: 127.22.45.84
I20260805 23:02:06.058462 22709 mini_ranger.cc:227] Ranger admin URL: http://127.22.45.84:42491
Aug 05, 2026 11:02:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 11:02:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 11:02:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 11:02:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 11:02:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 11:02:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 11:02:07 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 23:02:08.568969 22709 mini_ranger.cc:160] Time spent starting Ranger: real 11.098s user 0.000s sys 0.085s
Aug 05, 2026 11:02:28 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 11:02:28 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 05, 2026 11:02:28 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 11:02:28 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 11:02:29 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 23:02:30.478729 22709 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/rangerkms_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/rangerkms_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.45.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.45.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 23:02:30 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970950, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 23:02:30.690384 22709 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 23:02:30.719933 22709 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 23:02:31.597388 22709 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 23:02:31.597586 22709 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms
I20260805 23:02:31.597724 22709 mini_ranger_kms.cc:227] Using postgres at 127.22.45.84:51741
2026-08-05 23:02:32,070 [I] DB FLAVOR :POSTGRES
2026-08-05 23:02:32,071 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 23:02:32,071 [I] Checking connection
2026-08-05 23:02:32,071 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 23:02:32,330 [I] connection success
2026-08-05 23:02:32,330 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 23:02:32,330 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 23:02:32,330 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 23:02:32,601 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 23:02:32,602 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 23:02:32,602 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 23:02:32,602 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:51741/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 23:02:32,906 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 23:02:33.438720 22709 mini_ranger_kms.cc:310] Created kms service
I20260805 23:02:33.673466 22709 mini_ranger_kms.cc:326] Created kudu user
I20260805 23:02:33.724116 22709 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 23:02:33 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970950, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:02:34.162498 22709 mini_ranger_kms.cc:384] Added ranger policy
I20260805 23:02:34.164536 22709 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 23:02:34.164629 22709 mini_ranger_kms.cc:240] Using host: 127.22.45.84
I20260805 23:02:34.189513 22709 mini_ranger_kms.cc:276] Ranger KMS PID: 5930
I20260805 23:02:34.189760 22709 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.45.84:48041
Aug 05, 2026 11:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 11:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 11:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 11:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 11:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 11:02:35 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 05 23:02:36 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970956, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.45.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:02:36.677318 22709 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.987s user 0.114s sys 0.406s
I20260805 23:02:36.677737 22709 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 23:02:36.677992 22709 mini_ranger_kms.cc:401] 127.22.45.84:48041/kms/v1/keys
Aug 05 23:02:37 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970956, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.45.84@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
Aug 05 23:02:37 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970956, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.45.84@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
Aug 05 23:02:40 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:02:40.274703 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39881
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:43819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39881
--ranger_config_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:48041/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:02:40.757118 6000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:02:40.757555 6000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:02:40.757668 6000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:02:40.769140 6000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:02:40.769379 6000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:02:40.769497 6000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:02:40.769682 6000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:02:40.769830 6000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:02:40.782311 6000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.45.84:48041/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39881
--ranger_config_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:02:40.783864 6000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:02:40.785373 6000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:02:40.803476 6007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:02:40.803422 6008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:02:40.803350 6011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:02:40.805086 6000 server_base.cc:1034] running on GCE node
I20260805 23:02:40.806330 6000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:02:40.808300 6000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:02:40.809605 6000 hybrid_clock.cc:648] HybridClock initialized: now 1785970960809513 us; error 58 us; skew 500 ppm
I20260805 23:02:40.810120 6000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:02:40 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970960, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:02:40.823242 6000 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:02:40.825526 6000 webserver.cc:460] Webserver started at http://127.22.45.126:35789/ using document root <none> and password file <none>
I20260805 23:02:40.826404 6000 fs_manager.cc:359] Metadata directory not provided
I20260805 23:02:40.826586 6000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:02:40.827028 6000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:02:40 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970960, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:02:40.898337 6000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "8b4907c3305041f8a2f207a5be29a979"
format_stamp: "Formatted at 2026-08-05 23:02:40 on dist-test-slave-1vmg"
server_key: "3295e60f61a9ea97f087aa84ea8f5aac"
server_key_iv: "27fe6f4e0fa2bb7e77c369e99aa4948a"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:40.899853 6000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "8b4907c3305041f8a2f207a5be29a979"
format_stamp: "Formatted at 2026-08-05 23:02:40 on dist-test-slave-1vmg"
server_key: "3295e60f61a9ea97f087aa84ea8f5aac"
server_key_iv: "27fe6f4e0fa2bb7e77c369e99aa4948a"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:40.909941 6000 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.009s sys 0.000s
I20260805 23:02:40.935453 6022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:40.937561 6000 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.002s
I20260805 23:02:40.937950 6000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "8b4907c3305041f8a2f207a5be29a979"
format_stamp: "Formatted at 2026-08-05 23:02:40 on dist-test-slave-1vmg"
server_key: "3295e60f61a9ea97f087aa84ea8f5aac"
server_key_iv: "27fe6f4e0fa2bb7e77c369e99aa4948a"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:40.938390 6000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:02:40.969437 6000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:02:40.975790 6000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:02:40.976198 6000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:02:41.011049 6000 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:39881
I20260805 23:02:41.011171 6093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:39881 every 8 connection(s)
I20260805 23:02:41.013628 6000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:02:41.016552 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 6000
I20260805 23:02:41.016775 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:02:41.017719 22709 external_mini_cluster.cc:1428] Setting key 18bfcc254b83c0bddaad80aec0a57086
I20260805 23:02:41.021675 6094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:02:41.044981 6094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979: Bootstrap starting.
I20260805 23:02:41.049901 6094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979: Neither blocks nor log segments found. Creating new log.
I20260805 23:02:41.051328 6094 log.cc:824] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979: Log is configured to *not* fsync() on all Append() calls
Aug 05 23:02:41 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:02:41.056836 6094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979: No bootstrap required, opened a new log
I20260805 23:02:41.066493 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:41.020595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43990 (local address 127.22.45.126:39881)
0805 23:02:41.035905 (+ 15310us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:41.035926 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:41.035993 (+ 67us) server_negotiation.cc:407] Connection header received
0805 23:02:41.038971 (+ 2978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:41.039016 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:41.039775 (+ 759us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:41.040399 (+ 624us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:41.042209 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:41.044627 (+ 2418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:41.046745 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:41.048165 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:41.048395 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:41.054559 (+ 6164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:41.054572 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:41.054607 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:41.054667 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:41.059410 (+ 4743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:41.060670 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:41.060683 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:41.060696 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:41.060955 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:41.061447 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:41.061453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:41.061456 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:41.062452 (+ 996us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:41.062812 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:41.064112 (+ 1300us) server_negotiation.cc:299] Negotiation successful
0805 23:02:41.064693 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14908,"thread_start_us":16773,"threads_started":1}
I20260805 23:02:41.068022 6094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4907c3305041f8a2f207a5be29a979" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39881 } }
I20260805 23:02:41.068655 6094 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:02:41.068796 6094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b4907c3305041f8a2f207a5be29a979, State: Initialized, Role: FOLLOWER
I20260805 23:02:41.069614 6094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4907c3305041f8a2f207a5be29a979" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39881 } }
I20260805 23:02:41.069952 6094 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:02:41.070118 6094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:02:41.070333 6094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:02:41.073004 6094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4907c3305041f8a2f207a5be29a979" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39881 } }
I20260805 23:02:41.073701 6094 leader_election.cc:302] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b4907c3305041f8a2f207a5be29a979; no voters:
I20260805 23:02:41.074652 6094 leader_election.cc:288] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:02:41.074783 6100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:02:41.077421 6094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:02:41.078073 6100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [term 1 LEADER]: Becoming Leader. State: Replica: 8b4907c3305041f8a2f207a5be29a979, State: Running, Role: LEADER
I20260805 23:02:41.078963 6100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4907c3305041f8a2f207a5be29a979" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39881 } }
I20260805 23:02:41.083230 6102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b4907c3305041f8a2f207a5be29a979. Latest consensus state: current_term: 1 leader_uuid: "8b4907c3305041f8a2f207a5be29a979" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4907c3305041f8a2f207a5be29a979" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39881 } } }
I20260805 23:02:41.083794 6102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [sys.catalog]: This master's current role is: LEADER
I20260805 23:02:41.084544 6101 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b4907c3305041f8a2f207a5be29a979" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b4907c3305041f8a2f207a5be29a979" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39881 } } }
I20260805 23:02:41.084957 6101 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979 [sys.catalog]: This master's current role is: LEADER
I20260805 23:02:41.100615 6108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:02:41.110219 6108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:02:41.111366 6094 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 23:02:41.148497 6108 catalog_manager.cc:1347] Generated new cluster ID: 55c44672a99b4c958154899d2c5980d7
I20260805 23:02:41.148810 6108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:02:41.169927 6108 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:02:41.172173 6108 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:02:41.186497 6108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979: Generated new TSK 0
I20260805 23:02:41.188035 6108 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:02:42.041086 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:48041/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39881
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:43819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:02:42 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785970962, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260805 23:02:42.549369 6160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:02:42.549902 6160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:02:42.550089 6160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:02:42.563035 6160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:02:42.563267 6160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:02:42.563483 6160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:02:42.580718 6160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.45.84:48041/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:02:42.582909 6160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:02:42.585124 6160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:02:42.605463 6173 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:02:42.606508 6175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:02:42.616029 6160 server_base.cc:1034] running on GCE node
W20260805 23:02:42.616904 6177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:02:42.617944 6160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:02:42.619614 6160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:02:42.621001 6160 hybrid_clock.cc:648] HybridClock initialized: now 1785970962620871 us; error 112 us; skew 500 ppm
I20260805 23:02:42.621585 6160 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:02:42 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970962, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:02:42.627784 6160 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:02:42.631127 6160 webserver.cc:460] Webserver started at http://127.22.45.65:40829/ using document root <none> and password file <none>
I20260805 23:02:42.632339 6160 fs_manager.cc:359] Metadata directory not provided
I20260805 23:02:42.632579 6160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:02:42.633059 6160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:02:42 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970962, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:02:42.665447 6160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "887e2c001d4441dba938700b5409f08b"
format_stamp: "Formatted at 2026-08-05 23:02:42 on dist-test-slave-1vmg"
server_key: "321ae48bb7aabe2766dc243217ccc864"
server_key_iv: "77a6f51e116e0ec3c773d0e5ed7735a4"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:42.667604 6160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "887e2c001d4441dba938700b5409f08b"
format_stamp: "Formatted at 2026-08-05 23:02:42 on dist-test-slave-1vmg"
server_key: "321ae48bb7aabe2766dc243217ccc864"
server_key_iv: "77a6f51e116e0ec3c773d0e5ed7735a4"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:42.685796 6160 fs_manager.cc:691] Time spent creating directory manager: real 0.017s user 0.014s sys 0.001s
I20260805 23:02:42.710984 6185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:42.713408 6160 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260805 23:02:42.713688 6160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "887e2c001d4441dba938700b5409f08b"
format_stamp: "Formatted at 2026-08-05 23:02:42 on dist-test-slave-1vmg"
server_key: "321ae48bb7aabe2766dc243217ccc864"
server_key_iv: "77a6f51e116e0ec3c773d0e5ed7735a4"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:42.714023 6160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:02:42.750458 6160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:02:42.757376 6160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:02:42.758047 6160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:02:42.765097 6160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:02:42.771231 6160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:02:42.771492 6160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:42.771847 6160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:02:42.772075 6160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:42.872228 6160 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:44515
I20260805 23:02:42.872285 6341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:44515 every 8 connection(s)
I20260805 23:02:42.873898 6160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:02:42.876171 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 6160
I20260805 23:02:42.876417 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:02:42.877435 22709 external_mini_cluster.cc:1428] Setting key 1830cea19d80940d4cf60e183de6e24e
Aug 05 23:02:42 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970962, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:02:42.951122 6346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:42.895157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:58819 (local address 127.22.45.126:39881)
0805 23:02:42.920274 (+ 25117us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:42.920282 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:42.920317 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:02:42.927699 (+ 7382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:42.927707 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:42.927844 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:42.927970 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:42.930663 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:42.931877 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:42.934983 (+ 3106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:42.935664 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:42.935799 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:42.941517 (+ 5718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:42.941526 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:42.941530 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:42.941584 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:42.946151 (+ 4567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:42.947534 (+ 1383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:42.947541 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:42.947545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:42.947792 (+ 247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:42.948521 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:42.948527 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:42.948530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:42.948985 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:42.949140 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:42.950388 (+ 1248us) server_negotiation.cc:299] Negotiation successful
0805 23:02:42.950674 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24874,"thread_start_us":26598,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
I20260805 23:02:42.954325 6345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:42.894302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39881 (local address 127.22.45.65:58819)
0805 23:02:42.918019 (+ 23717us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:42.918104 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:42.926054 (+ 7950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:42.928536 (+ 2482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:42.928551 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:42.929364 (+ 813us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:02:42.930389 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:42.930424 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:42.932170 (+ 1746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:42.932175 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:42.934716 (+ 2541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:42.934738 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:42.936359 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:42.936368 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:42.936711 (+ 343us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:42.937726 (+ 1015us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:02:42.937760 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:02:42.941084 (+ 3324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:02:42.946420 (+ 5336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:02:42.946433 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:02:42.946459 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:02:42.947334 (+ 875us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:02:42.947988 (+ 654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:02:42.947994 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:02:42.947998 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:02:42.948354 (+ 356us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:02:42.949284 (+ 930us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:02:42.949296 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:02:42.949862 (+ 566us) client_negotiation.cc:769] Sending connection context
0805 23:02:42.951758 (+ 1896us) client_negotiation.cc:240] Negotiation successful
0805 23:02:42.952477 (+ 719us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23174,"thread_start_us":25888,"threads_started":1}
I20260805 23:02:42.956960 6342 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39881
I20260805 23:02:42.957449 6342 heartbeater.cc:464] Registering TS with master...
I20260805 23:02:42.958556 6342 heartbeater.cc:511] Master 127.22.45.126:39881 requested a full tablet report, sending...
I20260805 23:02:42.961947 6048 ts_manager.cc:194] Registered new tserver with Master: 887e2c001d4441dba938700b5409f08b (127.22.45.65:44515)
I20260805 23:02:42.964215 6048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:58819
Aug 05 23:02:42 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970962, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
W20260805 23:02:43.014055 22709 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.22.45.66: real 0.133s user 0.003s sys 0.023s
I20260805 23:02:43.015064 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:48041/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39881
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:43819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:02:43 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970962, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
W20260805 23:02:43.628307 6351 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:02:43.628904 6351 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:02:43.629179 6351 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:02:43.642555 6351 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:02:43.642872 6351 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:02:43.643244 6351 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:02:43.662039 6351 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.45.84:48041/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:02:43.664505 6351 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:02:43.666942 6351 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:02:43.687778 6366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:02:43.693624 6370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:02:43.693758 6351 server_base.cc:1034] running on GCE node
W20260805 23:02:43.694013 6367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:02:43.695154 6351 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:02:43.696889 6351 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:02:43.698325 6351 hybrid_clock.cc:648] HybridClock initialized: now 1785970963698153 us; error 104 us; skew 500 ppm
I20260805 23:02:43.698812 6351 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:02:43 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970963, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:02:43.705114 6351 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:02:43.707736 6351 webserver.cc:460] Webserver started at http://127.22.45.66:37913/ using document root <none> and password file <none>
I20260805 23:02:43.708942 6351 fs_manager.cc:359] Metadata directory not provided
I20260805 23:02:43.709143 6351 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:02:43.709795 6351 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:02:43 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970963, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:02:43.731727 6351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "cabc7a4cef684a1f92d4bcc8d088552d"
format_stamp: "Formatted at 2026-08-05 23:02:43 on dist-test-slave-1vmg"
server_key: "a37acb6e966226c86e91b4594b7bc5ae"
server_key_iv: "1b36c86a2a70def74fdd1414d647afb0"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:43.733706 6351 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "cabc7a4cef684a1f92d4bcc8d088552d"
format_stamp: "Formatted at 2026-08-05 23:02:43 on dist-test-slave-1vmg"
server_key: "a37acb6e966226c86e91b4594b7bc5ae"
server_key_iv: "1b36c86a2a70def74fdd1414d647afb0"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:43.743228 6351 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.009s sys 0.000s
I20260805 23:02:43.764154 6379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:43.766096 6351 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:02:43.766372 6351 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "cabc7a4cef684a1f92d4bcc8d088552d"
format_stamp: "Formatted at 2026-08-05 23:02:43 on dist-test-slave-1vmg"
server_key: "a37acb6e966226c86e91b4594b7bc5ae"
server_key_iv: "1b36c86a2a70def74fdd1414d647afb0"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:43.766678 6351 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:02:43.790673 6351 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:02:43.796271 6351 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:02:43.796693 6351 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:02:43.798163 6351 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:02:43.800257 6351 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:02:43.800417 6351 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:43.800560 6351 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:02:43.800688 6351 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:43.862435 6351 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:36897
I20260805 23:02:43.862541 6528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:36897 every 8 connection(s)
I20260805 23:02:43.864100 6351 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:02:43.867095 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 6351
I20260805 23:02:43.867275 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:02:43.867815 22709 external_mini_cluster.cc:1428] Setting key 8950e144bc480ce244bb9e736151ef84
Aug 05 23:02:43 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970963, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:02:43.905134 6532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:43.868952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:47813 (local address 127.22.45.126:39881)
0805 23:02:43.882527 (+ 13575us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:43.882535 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:43.882570 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:02:43.883141 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:43.883148 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:43.883263 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:43.883396 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:43.885828 (+ 2432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:43.887144 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:43.890136 (+ 2992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:43.890940 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:43.891085 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:43.896366 (+ 5281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:43.896373 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:43.896377 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:43.896428 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:43.900628 (+ 4200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:43.901883 (+ 1255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:43.901890 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:43.901893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:43.902147 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:43.902767 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:43.902773 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:43.902777 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:43.903244 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:43.903409 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:43.904416 (+ 1007us) server_negotiation.cc:299] Negotiation successful
0805 23:02:43.904704 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13403,"thread_start_us":13625,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
I20260805 23:02:43.906687 6531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:43.868188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39881 (local address 127.22.45.66:47813)
0805 23:02:43.869332 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:43.869400 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:43.882697 (+ 13297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:43.883737 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:43.883751 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:43.884541 (+ 790us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:02:43.885544 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:43.885575 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:43.887357 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:43.887363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:43.889901 (+ 2538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:43.889922 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:43.891283 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:43.891293 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:43.891726 (+ 433us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:43.892738 (+ 1012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:02:43.892773 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:02:43.895999 (+ 3226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:02:43.900855 (+ 4856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:02:43.900868 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:02:43.900893 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:02:43.901693 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:02:43.902302 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:02:43.902308 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:02:43.902311 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:02:43.902620 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:02:43.903415 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:02:43.903425 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:02:43.903951 (+ 526us) client_negotiation.cc:769] Sending connection context
0805 23:02:43.904285 (+ 334us) client_negotiation.cc:240] Negotiation successful
0805 23:02:43.904965 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":472,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
I20260805 23:02:43.908689 6529 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39881
I20260805 23:02:43.909067 6529 heartbeater.cc:464] Registering TS with master...
I20260805 23:02:43.910251 6529 heartbeater.cc:511] Master 127.22.45.126:39881 requested a full tablet report, sending...
I20260805 23:02:43.912580 6048 ts_manager.cc:194] Registered new tserver with Master: cabc7a4cef684a1f92d4bcc8d088552d (127.22.45.66:36897)
I20260805 23:02:43.913682 6048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:47813
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:02:43.943876 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:48041/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39881
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:43819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:02:43.969059 6342 heartbeater.cc:503] Master 127.22.45.126:39881 was elected leader, sending a full tablet report...
W20260805 23:02:44.446575 6536 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:02:44.447081 6536 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:02:44.447352 6536 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:02:44.457698 6536 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:02:44.457954 6536 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:02:44.458122 6536 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:02:44.472512 6536 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.45.84:48041/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39881
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:02:44.474119 6536 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:02:44.475863 6536 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:02:44.492918 6542 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:02:44.493991 6545 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:02:44.494127 6543 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:02:44.494233 6536 server_base.cc:1034] running on GCE node
I20260805 23:02:44.495081 6536 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:02:44.496155 6536 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:02:44.497426 6536 hybrid_clock.cc:648] HybridClock initialized: now 1785970964497353 us; error 59 us; skew 500 ppm
I20260805 23:02:44.497815 6536 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:02:44 dist-test-slave-1vmg krb5kdc[5377](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970964, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:02:44.501586 6536 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:02:44.504016 6536 webserver.cc:460] Webserver started at http://127.22.45.67:34123/ using document root <none> and password file <none>
I20260805 23:02:44.504793 6536 fs_manager.cc:359] Metadata directory not provided
I20260805 23:02:44.504935 6536 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:02:44.505271 6536 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:02:44 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970964, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:02:44.523680 6536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "b53de720537a45a4a2a9edac91a64d85"
format_stamp: "Formatted at 2026-08-05 23:02:44 on dist-test-slave-1vmg"
server_key: "4536000e674c7061ecab3c2e4b33182a"
server_key_iv: "d7f10540d46c5401c1269bee1d5e4e37"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:44.525038 6536 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "b53de720537a45a4a2a9edac91a64d85"
format_stamp: "Formatted at 2026-08-05 23:02:44 on dist-test-slave-1vmg"
server_key: "4536000e674c7061ecab3c2e4b33182a"
server_key_iv: "d7f10540d46c5401c1269bee1d5e4e37"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:44.532806 6536 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.006s
I20260805 23:02:44.551789 6556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:44.553568 6536 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:02:44.553782 6536 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "b53de720537a45a4a2a9edac91a64d85"
format_stamp: "Formatted at 2026-08-05 23:02:44 on dist-test-slave-1vmg"
server_key: "4536000e674c7061ecab3c2e4b33182a"
server_key_iv: "d7f10540d46c5401c1269bee1d5e4e37"
server_key_version: "kuduclusterkey@0"
I20260805 23:02:44.554077 6536 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:02:44.591535 6536 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:02:44.597689 6536 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:02:44.598119 6536 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:02:44.599990 6536 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:02:44.602897 6536 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:02:44.603127 6536 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260805 23:02:44.603404 6536 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:02:44.603552 6536 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:02:44.675581 6536 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46233
I20260805 23:02:44.675639 6709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46233 every 8 connection(s)
I20260805 23:02:44.677711 6536 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:02:44.682415 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 6536
I20260805 23:02:44.682621 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:02:44.683122 22709 external_mini_cluster.cc:1428] Setting key 6f1c2a244d665a4bc681160461193200
Aug 05 23:02:44 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970964, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:02:44.708120 6713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.681535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:38971 (local address 127.22.45.126:39881)
0805 23:02:44.682624 (+ 1089us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:44.682630 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:44.684722 (+ 2092us) server_negotiation.cc:407] Connection header received
0805 23:02:44.687603 (+ 2881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:44.687609 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:44.687755 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:44.687987 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:44.689865 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.691028 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.692895 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.693846 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.693989 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.699662 (+ 5673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:44.699668 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:44.699673 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:44.699744 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:44.703878 (+ 4134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:44.704870 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:44.704875 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:44.704878 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:44.705144 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:44.705676 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:44.705680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:44.705682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:44.706093 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:44.706320 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:44.707212 (+ 892us) server_negotiation.cc:299] Negotiation successful
0805 23:02:44.707548 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":934,"thread_start_us":724,"threads_started":1}
I20260805 23:02:44.709165 6714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.682281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39881 (local address 127.22.45.67:38971)
0805 23:02:44.683542 (+ 1261us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:44.683598 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:44.687318 (+ 3720us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:44.688313 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:44.688323 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:44.688950 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:02:44.689675 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.689697 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.691192 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.691196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.692651 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.692666 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.694154 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.694165 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.694477 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.695472 (+ 995us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:02:44.695501 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:02:44.699328 (+ 3827us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:02:44.704102 (+ 4774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:02:44.704113 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:02:44.704134 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:02:44.704703 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:02:44.705289 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:02:44.705295 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:02:44.705299 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:02:44.705542 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:02:44.706275 (+ 733us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:02:44.706285 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:02:44.706714 (+ 429us) client_negotiation.cc:769] Sending connection context
0805 23:02:44.707081 (+ 367us) client_negotiation.cc:240] Negotiation successful
0805 23:02:44.707815 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"thread_start_us":716,"threads_started":1}
I20260805 23:02:44.711580 6710 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39881
I20260805 23:02:44.712054 6710 heartbeater.cc:464] Registering TS with master...
I20260805 23:02:44.713088 6710 heartbeater.cc:511] Master 127.22.45.126:39881 requested a full tablet report, sending...
I20260805 23:02:44.714854 6048 ts_manager.cc:194] Registered new tserver with Master: b53de720537a45a4a2a9edac91a64d85 (127.22.45.67:46233)
I20260805 23:02:44.715869 6048 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:38971
I20260805 23:02:44.726500 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:02:44.752444 6713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.733369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40146 (local address 127.22.45.126:39881)
0805 23:02:44.733616 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:44.733624 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:44.734375 (+ 751us) server_negotiation.cc:407] Connection header received
0805 23:02:44.734580 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:44.734584 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:44.734685 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:44.734780 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:44.737301 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.738146 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.740304 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.740828 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.740964 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.744700 (+ 3736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:44.744707 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:44.744710 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:44.744762 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:44.748898 (+ 4136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:44.749992 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:44.750017 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:44.750020 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:44.750229 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:44.750652 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:44.750656 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:44.750658 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:44.751111 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:44.751348 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:44.751674 (+ 326us) server_negotiation.cc:299] Negotiation successful
0805 23:02:44.751936 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 23:02:44.758042 6048 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40146:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:02:44.769387 6048 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:02:44.805748 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.789767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36897 (local address 127.0.0.1:34080)
0805 23:02:44.790825 (+ 1058us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:44.790858 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:44.791162 (+ 304us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:44.792857 (+ 1695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:44.792867 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:44.792906 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:02:44.793815 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.793832 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.797101 (+ 3269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.797108 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.800414 (+ 3306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.800440 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.804151 (+ 3711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.804159 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.804471 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.804536 (+ 65us) client_negotiation.cc:769] Sending connection context
0805 23:02:44.804727 (+ 191us) client_negotiation.cc:240] Negotiation successful
0805 23:02:44.805142 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":851,"thread_start_us":671,"threads_started":1}
I20260805 23:02:44.807804 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.789835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34080 (local address 127.22.45.66:36897)
0805 23:02:44.790723 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:44.790733 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:44.791080 (+ 347us) server_negotiation.cc:407] Connection header received
0805 23:02:44.791469 (+ 389us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:44.791479 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:44.791781 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:44.792273 (+ 492us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:02:44.794074 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.796807 (+ 2733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.800770 (+ 3963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.803416 (+ 2646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.803632 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.803905 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:44.806840 (+ 2935us) server_negotiation.cc:299] Negotiation successful
0805 23:02:44.807098 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":730,"thread_start_us":556,"threads_started":1}
I20260805 23:02:44.814357 6438 tablet_service.cc:1467] Processing CreateTablet for tablet 4852911f3a244334b5ef79bd9d99d50b (DEFAULT_TABLE table=test-table [id=c0ee4182a23f441e89ffeb6de213fc83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:02:44.816533 6438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4852911f3a244334b5ef79bd9d99d50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:02:44.816731 6728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.793265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46233 (local address 127.0.0.1:38300)
0805 23:02:44.806422 (+ 13157us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:44.806447 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:44.806612 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:44.808076 (+ 1464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:44.808082 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:44.808123 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:02:44.808423 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.808438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.810853 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.810859 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.812901 (+ 2042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.812921 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.815848 (+ 2927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.815854 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.816002 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.816037 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:02:44.816130 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 23:02:44.816346 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13035,"thread_start_us":15983,"threads_started":1}
I20260805 23:02:44.816879 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.793257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38300 (local address 127.22.45.67:46233)
0805 23:02:44.806299 (+ 13042us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:44.806311 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:44.806661 (+ 350us) server_negotiation.cc:407] Connection header received
0805 23:02:44.806806 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:44.806817 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:44.807236 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:44.807599 (+ 363us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:02:44.808668 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.810675 (+ 2007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.813172 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.815361 (+ 2189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.815498 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.815833 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:44.816207 (+ 374us) server_negotiation.cc:299] Negotiation successful
0805 23:02:44.816392 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12762,"thread_start_us":13115,"threads_started":1}
I20260805 23:02:44.819032 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.791284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55746)
0805 23:02:44.792731 (+ 1447us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:44.792787 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:44.793049 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:44.808651 (+ 15602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:44.808657 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:44.808697 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:02:44.809704 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.809719 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.813012 (+ 3293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.813018 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.815423 (+ 2405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.815443 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.817972 (+ 2529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.817980 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.818162 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.818198 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:02:44.818304 (+ 106us) client_negotiation.cc:240] Negotiation successful
0805 23:02:44.818460 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1252,"thread_start_us":997,"threads_started":1}
I20260805 23:02:44.819416 6731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.791768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55746 (local address 127.22.45.65:44515)
0805 23:02:44.807773 (+ 16005us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:44.807783 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:44.807817 (+ 34us) server_negotiation.cc:407] Connection header received
0805 23:02:44.807923 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:44.807932 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:44.808232 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:44.809942 (+ 1710us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:02:44.810337 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.812769 (+ 2432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.815674 (+ 2905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.817610 (+ 1936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.817783 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.818171 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:44.818375 (+ 204us) server_negotiation.cc:299] Negotiation successful
0805 23:02:44.818609 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15723,"thread_start_us":16558,"threads_started":1}
I20260805 23:02:44.822033 6624 tablet_service.cc:1467] Processing CreateTablet for tablet 4852911f3a244334b5ef79bd9d99d50b (DEFAULT_TABLE table=test-table [id=c0ee4182a23f441e89ffeb6de213fc83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:02:44.824103 6624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4852911f3a244334b5ef79bd9d99d50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:02:44.826086 6256 tablet_service.cc:1467] Processing CreateTablet for tablet 4852911f3a244334b5ef79bd9d99d50b (DEFAULT_TABLE table=test-table [id=c0ee4182a23f441e89ffeb6de213fc83]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:02:44.828598 6256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4852911f3a244334b5ef79bd9d99d50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:02:44.841818 6735 tablet_bootstrap.cc:492] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Bootstrap starting.
I20260805 23:02:44.844728 6736 tablet_bootstrap.cc:492] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Bootstrap starting.
I20260805 23:02:44.847258 6735 tablet_bootstrap.cc:654] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Neither blocks nor log segments found. Creating new log.
I20260805 23:02:44.849576 6735 log.cc:824] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:02:44.850033 6737 tablet_bootstrap.cc:492] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: Bootstrap starting.
I20260805 23:02:44.851061 6736 tablet_bootstrap.cc:654] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Neither blocks nor log segments found. Creating new log.
I20260805 23:02:44.852603 6736 log.cc:824] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Log is configured to *not* fsync() on all Append() calls
I20260805 23:02:44.853987 6735 tablet_bootstrap.cc:492] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: No bootstrap required, opened a new log
I20260805 23:02:44.854347 6735 ts_tablet_manager.cc:1397] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.005s
I20260805 23:02:44.855527 6737 tablet_bootstrap.cc:654] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: Neither blocks nor log segments found. Creating new log.
I20260805 23:02:44.855641 6736 tablet_bootstrap.cc:492] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: No bootstrap required, opened a new log
I20260805 23:02:44.855952 6736 ts_tablet_manager.cc:1397] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.009s
I20260805 23:02:44.857388 6737 log.cc:824] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: Log is configured to *not* fsync() on all Append() calls
I20260805 23:02:44.861732 6737 tablet_bootstrap.cc:492] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: No bootstrap required, opened a new log
I20260805 23:02:44.862149 6737 ts_tablet_manager.cc:1397] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.006s
I20260805 23:02:44.867556 6735 raft_consensus.cc:348] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.868526 6735 raft_consensus.cc:374] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:02:44.868772 6735 raft_consensus.cc:729] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cabc7a4cef684a1f92d4bcc8d088552d, State: Initialized, Role: FOLLOWER
I20260805 23:02:44.869935 6735 consensus_queue.cc:260] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.871145 6736 raft_consensus.cc:348] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.871997 6736 raft_consensus.cc:374] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:02:44.872181 6736 raft_consensus.cc:729] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b53de720537a45a4a2a9edac91a64d85, State: Initialized, Role: FOLLOWER
I20260805 23:02:44.873452 6736 consensus_queue.cc:260] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.880172 6529 heartbeater.cc:503] Master 127.22.45.126:39881 was elected leader, sending a full tablet report...
I20260805 23:02:44.881814 6735 ts_tablet_manager.cc:1428] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Time spent starting tablet: real 0.027s user 0.020s sys 0.004s
I20260805 23:02:44.884455 6737 raft_consensus.cc:348] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.885259 6737 raft_consensus.cc:374] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:02:44.885497 6737 raft_consensus.cc:729] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 887e2c001d4441dba938700b5409f08b, State: Initialized, Role: FOLLOWER
I20260805 23:02:44.886621 6737 consensus_queue.cc:260] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.888756 6710 heartbeater.cc:503] Master 127.22.45.126:39881 was elected leader, sending a full tablet report...
I20260805 23:02:44.893468 6736 ts_tablet_manager.cc:1428] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Time spent starting tablet: real 0.037s user 0.025s sys 0.006s
I20260805 23:02:44.895596 6737 ts_tablet_manager.cc:1428] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: Time spent starting tablet: real 0.033s user 0.023s sys 0.002s
W20260805 23:02:44.929477 6343 tablet.cc:2369] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:02:44.934233 6712 tablet.cc:2369] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:02:44.970970 6748 raft_consensus.cc:482] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:02:44.971472 6748 raft_consensus.cc:504] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.973933 6748 leader_election.cc:288] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cabc7a4cef684a1f92d4bcc8d088552d (127.22.45.66:36897), 887e2c001d4441dba938700b5409f08b (127.22.45.65:44515)
I20260805 23:02:44.981374 6714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.974421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36897 (local address 127.22.45.67:42819)
0805 23:02:44.974622 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:44.974645 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:44.974800 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:44.975279 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:44.975285 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:44.975318 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:02:44.975795 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.975808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.977135 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.977139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.979127 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.979146 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.980510 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.980516 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.980748 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.980791 (+ 43us) client_negotiation.cc:769] Sending connection context
0805 23:02:44.980926 (+ 135us) client_negotiation.cc:240] Negotiation successful
0805 23:02:44.981085 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63,"mutex_wait_us":1}
I20260805 23:02:44.981415 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.974569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:42819 (local address 127.22.45.66:36897)
0805 23:02:44.974892 (+ 323us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:44.974899 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:44.974948 (+ 49us) server_negotiation.cc:407] Connection header received
0805 23:02:44.975031 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:44.975035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:44.975098 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:44.975202 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:02:44.975971 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.976980 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.979307 (+ 2327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.980317 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.980500 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.980588 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:44.980957 (+ 369us) server_negotiation.cc:299] Negotiation successful
0805 23:02:44.981088 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 23:02:44.983317 6469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4852911f3a244334b5ef79bd9d99d50b" candidate_uuid: "b53de720537a45a4a2a9edac91a64d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" is_pre_election: true
I20260805 23:02:44.983876 6731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.975334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:37897 (local address 127.22.45.65:44515)
0805 23:02:44.975649 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:44.975654 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:44.976263 (+ 609us) server_negotiation.cc:407] Connection header received
0805 23:02:44.976435 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:44.976439 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:44.976502 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:44.976580 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:02:44.977510 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.978560 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.981194 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.982718 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.982941 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.983027 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:44.983428 (+ 401us) server_negotiation.cc:299] Negotiation successful
0805 23:02:44.983614 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 23:02:44.983929 6750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:44.974883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.22.45.67:37897)
0805 23:02:44.976140 (+ 1257us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:44.976156 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 23:02:44.976298 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:02:44.976624 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:02:44.976629 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:02:44.976654 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:02:44.977247 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.977260 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.978736 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.978740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.981005 (+ 2265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:02:44.981020 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:02:44.983048 (+ 2028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:02:44.983054 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:02:44.983235 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:44.983265 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 23:02:44.983352 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 23:02:44.983469 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1134,"mutex_wait_us":23,"thread_start_us":1006,"threads_started":1}
I20260805 23:02:44.984216 6469 raft_consensus.cc:2454] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b53de720537a45a4a2a9edac91a64d85 in term 0.
I20260805 23:02:44.985517 6560 leader_election.cc:302] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b53de720537a45a4a2a9edac91a64d85, cabc7a4cef684a1f92d4bcc8d088552d; no voters:
I20260805 23:02:44.985499 6279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4852911f3a244334b5ef79bd9d99d50b" candidate_uuid: "b53de720537a45a4a2a9edac91a64d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "887e2c001d4441dba938700b5409f08b" is_pre_election: true
I20260805 23:02:44.986042 6748 raft_consensus.cc:2781] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:02:44.986227 6748 raft_consensus.cc:482] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:02:44.986194 6279 raft_consensus.cc:2454] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b53de720537a45a4a2a9edac91a64d85 in term 0.
I20260805 23:02:44.986335 6748 raft_consensus.cc:3037] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:02:44.990782 6748 raft_consensus.cc:504] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:44.992115 6748 leader_election.cc:288] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [CANDIDATE]: Term 1 election: Requested vote from peers cabc7a4cef684a1f92d4bcc8d088552d (127.22.45.66:36897), 887e2c001d4441dba938700b5409f08b (127.22.45.65:44515)
I20260805 23:02:44.993016 6469 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4852911f3a244334b5ef79bd9d99d50b" candidate_uuid: "b53de720537a45a4a2a9edac91a64d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cabc7a4cef684a1f92d4bcc8d088552d"
I20260805 23:02:44.993017 6279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4852911f3a244334b5ef79bd9d99d50b" candidate_uuid: "b53de720537a45a4a2a9edac91a64d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "887e2c001d4441dba938700b5409f08b"
I20260805 23:02:44.993319 6279 raft_consensus.cc:3037] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:02:44.993381 6469 raft_consensus.cc:3037] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:02:44.997443 6279 raft_consensus.cc:2454] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b53de720537a45a4a2a9edac91a64d85 in term 1.
I20260805 23:02:44.997532 6469 raft_consensus.cc:2454] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b53de720537a45a4a2a9edac91a64d85 in term 1.
I20260805 23:02:44.998247 6560 leader_election.cc:302] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 887e2c001d4441dba938700b5409f08b, b53de720537a45a4a2a9edac91a64d85; no voters:
I20260805 23:02:44.998790 6748 raft_consensus.cc:2781] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:02:44.999840 6748 raft_consensus.cc:686] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 1 LEADER]: Becoming Leader. State: Replica: b53de720537a45a4a2a9edac91a64d85, State: Running, Role: LEADER
I20260805 23:02:45.000582 6748 consensus_queue.cc:237] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } }
I20260805 23:02:45.007689 6046 catalog_manager.cc:5495] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to b53de720537a45a4a2a9edac91a64d85 (127.22.45.67). New cstate: current_term: 1 leader_uuid: "b53de720537a45a4a2a9edac91a64d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b53de720537a45a4a2a9edac91a64d85" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46233 } health_report { overall_health: HEALTHY } } }
I20260805 23:02:45.068282 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.060360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38314 (local address 127.22.45.67:46233)
0805 23:02:45.060570 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:45.060575 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:45.060597 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:02:45.060884 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:45.060889 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:45.060982 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:45.061128 (+ 146us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:02:45.061701 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.062888 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.064789 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.065652 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.065846 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:45.066798 (+ 952us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:02:45.067566 (+ 768us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:02:45.067710 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:45.067845 (+ 135us) server_negotiation.cc:299] Negotiation successful
0805 23:02:45.067945 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 23:02:45.079210 6469 raft_consensus.cc:1261] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 1 FOLLOWER]: Refusing update from remote peer b53de720537a45a4a2a9edac91a64d85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:02:45.079210 6279 raft_consensus.cc:1261] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 1 FOLLOWER]: Refusing update from remote peer b53de720537a45a4a2a9edac91a64d85: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:02:45.080497 6752 consensus_queue.cc:1035] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "887e2c001d4441dba938700b5409f08b" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 44515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:02:45.081056 6748 consensus_queue.cc:1035] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cabc7a4cef684a1f92d4bcc8d088552d" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:02:45.113961 6048 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:02:45.114548 6048 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40146:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:02:45.120069 6048 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b4907c3305041f8a2f207a5be29a979: Sending DeleteTablet for 3 replicas of tablet 4852911f3a244334b5ef79bd9d99d50b
I20260805 23:02:45.121658 6438 tablet_service.cc:1514] Processing DeleteTablet for tablet 4852911f3a244334b5ef79bd9d99d50b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:02:45 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:34080
I20260805 23:02:45.122206 6256 tablet_service.cc:1514] Processing DeleteTablet for tablet 4852911f3a244334b5ef79bd9d99d50b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:02:45 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:55746
I20260805 23:02:45.122756 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 6160
I20260805 23:02:45.123381 6624 tablet_service.cc:1514] Processing DeleteTablet for tablet 4852911f3a244334b5ef79bd9d99d50b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:02:45 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:38300
I20260805 23:02:45.133234 6774 tablet_replica.cc:330] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: stopping tablet replica
I20260805 23:02:45.133855 6774 raft_consensus.cc:2229] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:02:45.134675 6774 raft_consensus.cc:2258] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:02:45.135943 6773 tablet_replica.cc:330] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: stopping tablet replica
I20260805 23:02:45.136467 6773 raft_consensus.cc:2229] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:02:45.137099 6773 raft_consensus.cc:2258] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:02:45.139976 6774 ts_tablet_manager.cc:1905] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 05 23:02:45 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:02:45.146098 6771 tablet_replica.cc:330] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: stopping tablet replica
I20260805 23:02:45.146759 6771 raft_consensus.cc:2229] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:02:45.147416 6771 raft_consensus.cc:2258] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:02:45.147805 6773 ts_tablet_manager.cc:1905] T 4852911f3a244334b5ef79bd9d99d50b P 887e2c001d4441dba938700b5409f08b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:02:45.148836 6774 ts_tablet_manager.cc:1918] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:02:45.149137 6774 log.cc:1196] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/4852911f3a244334b5ef79bd9d99d50b
I20260805 23:02:45.149505 6771 ts_tablet_manager.cc:1905] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:02:45.149834 6774 ts_tablet_manager.cc:1939] T 4852911f3a244334b5ef79bd9d99d50b P b53de720537a45a4a2a9edac91a64d85: Deleting consensus metadata
I20260805 23:02:45.151844 6026 catalog_manager.cc:4841] TS b53de720537a45a4a2a9edac91a64d85 (127.22.45.67:46233): tablet 4852911f3a244334b5ef79bd9d99d50b (table test-table [id=c0ee4182a23f441e89ffeb6de213fc83]) successfully deleted
I20260805 23:02:45.154067 6731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.125322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55762 (local address 127.22.45.65:44515)
0805 23:02:45.125552 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:45.125560 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:45.132879 (+ 7319us) server_negotiation.cc:407] Connection header received
0805 23:02:45.133228 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:45.133235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:45.133334 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:45.133420 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:45.135622 (+ 2202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.136893 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.139100 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.139808 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.139916 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:45.145729 (+ 5813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:45.145744 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:45.145762 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:45.145809 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:45.149815 (+ 4006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:45.150906 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:45.150966 (+ 60us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:45.150970 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:45.151232 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:45.151851 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:45.151856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:45.151860 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:45.152355 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:45.152689 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:45.153326 (+ 637us) server_negotiation.cc:299] Negotiation successful
0805 23:02:45.153611 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 23:02:45.156790 6771 ts_tablet_manager.cc:1918] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:02:45.156822 6335 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:02:45.156985 6771 log.cc:1196] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/4852911f3a244334b5ef79bd9d99d50b
I20260805 23:02:45.157560 6771 ts_tablet_manager.cc:1939] T 4852911f3a244334b5ef79bd9d99d50b P cabc7a4cef684a1f92d4bcc8d088552d: Deleting consensus metadata
I20260805 23:02:45.159845 6026 catalog_manager.cc:4841] TS cabc7a4cef684a1f92d4bcc8d088552d (127.22.45.66:36897): tablet 4852911f3a244334b5ef79bd9d99d50b (table test-table [id=c0ee4182a23f441e89ffeb6de213fc83]) successfully deleted
I20260805 23:02:45.252552 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 6160
I20260805 23:02:45.275164 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 6351
W20260805 23:02:45.275108 6026 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.45.65:44515 (error 108)
I20260805 23:02:45.277002 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.276523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55770)
0805 23:02:45.276707 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:45.276817 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260805 23:02:45.277395 6026 catalog_manager.cc:4584] TS 887e2c001d4441dba938700b5409f08b (127.22.45.65:44515): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4852911f3a244334b5ef79bd9d99d50b: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Aug 05 23:02:45 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:02:45.291925 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.276689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.22.45.66:36897)
0805 23:02:45.276880 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:45.276886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:45.276907 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:02:45.276973 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:45.276978 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:45.277073 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:45.277178 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:45.278685 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.279626 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.280954 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.281355 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.281476 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:45.285846 (+ 4370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:45.285863 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:45.285879 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:45.285918 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:45.289064 (+ 3146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:45.289760 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:45.289768 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:45.289771 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:45.289911 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:45.290287 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:45.290290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:45.290293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:45.290715 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:45.291037 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:45.291342 (+ 305us) server_negotiation.cc:299] Negotiation successful
0805 23:02:45.291566 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 23:02:45.292714 6522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:02:45.331597 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.330952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55786)
0805 23:02:45.331235 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:45.331354 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260805 23:02:45.333174 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.332697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55794)
0805 23:02:45.332917 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:45.333004 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260805 23:02:45.394214 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.393720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55810)
0805 23:02:45.393912 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:45.394021 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260805 23:02:45.394827 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 6351
I20260805 23:02:45.401419 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.395186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55822)
0805 23:02:45.401048 (+ 5862us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:45.401214 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5642}
I20260805 23:02:45.421834 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 6536
Aug 05 23:02:45 dist-test-slave-1vmg krb5kdc[5377](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970960, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:02:45.441470 6733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.422672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38326 (local address 127.22.45.67:46233)
0805 23:02:45.422864 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 23:02:45.422870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:02:45.423002 (+ 132us) server_negotiation.cc:407] Connection header received
0805 23:02:45.423254 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:02:45.423258 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:02:45.423331 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:02:45.423438 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:02:45.425026 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.426241 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.427706 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:02:45.428186 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:02:45.428325 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:02:45.433526 (+ 5201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:02:45.433551 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:02:45.433574 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:02:45.433641 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:02:45.438027 (+ 4386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:45.439054 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:45.439067 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:45.439070 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:45.439265 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:02:45.439664 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:02:45.439673 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:02:45.439677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:02:45.440222 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:02:45.440612 (+ 390us) server_negotiation.cc:1035] Waiting for connection context
0805 23:02:45.440821 (+ 209us) server_negotiation.cc:299] Negotiation successful
0805 23:02:45.441080 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 23:02:45.442343 6704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:02:45.482547 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.481885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55832)
0805 23:02:45.482160 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:45.482292 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260805 23:02:45.483920 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:02:45.483427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:44515 (local address 127.0.0.1:55844)
0805 23:02:45.483650 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0805 23:02:45.483755 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:44515: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260805 23:02:45.567687 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 6536
I20260805 23:02:45.591719 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 6000
I20260805 23:02:45.593041 6087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:02:45.715056 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 6000
I20260805 23:02:45.749521 22709 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 23:02:46.086462 22709 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 23:02:46.086825 22709 mini_ranger.cc:66] Stopping Ranger...
I20260805 23:02:46.433992 22709 mini_ranger.cc:68] Stopped Ranger
2026-08-05 23:02:46.434 UTC [5423] LOG: received smart shutdown request
2026-08-05 23:02:46.439 UTC [5423] LOG: background worker "logical replication launcher" (PID 5435) exited with exit code 1
2026-08-05 23:02:46.440 UTC [5429] LOG: shutting down
2026-08-05 23:02:46.597 UTC [5423] LOG: database system is shut down
2026-08-05T23:02:46Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54873 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:02:46 dist-test-slave-1vmg krb5kdc[6799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:02:46 dist-test-slave-1vmg krb5kdc[6799](info): set up 2 sockets
Aug 05 23:02:46 dist-test-slave-1vmg krb5kdc[6799](info): commencing operation
krb5kdc: starting...
W20260805 23:02:47.919679 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.000s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:02:48 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785970968, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:02:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:02:48Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/rangeradmin_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/rangeradmin_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/rangerlookup_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/rangerlookup_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
I20260805 23:02:48.315728 22709 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskNZyF8v/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/postgres -l logfile start
2026-08-05 23:02:50.683 UTC [6837] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-05 23:02:50.684 UTC [6837] LOG: listening on IPv4 address "127.22.45.84", port 55779
2026-08-05 23:02:50.687 UTC [6837] LOG: listening on Unix socket "/tmp/.s.PGSQL.55779"
2026-08-05 23:02:50.711 UTC [6841] LOG: database system was shut down at 2026-08-05 23:02:49 UTC
2026-08-05 23:02:50.715 UTC [6837] LOG: database system is ready to accept connections
I20260805 23:02:51.784746 22709 mini_postgres.cc:96] Postgres bound to 55779
2026-08-05 23:02:51.806 UTC [6852] FATAL: database "slave" does not exist
127.22.45.84:55779 - accepting connections
I20260805 23:02:51.807268 22709 mini_ranger.cc:161] Starting Ranger...
I20260805 23:02:51.839788 22709 mini_ranger.cc:84] Created miniranger Postgres user
I20260805 23:02:52.304735 22709 mini_ranger.cc:87] Created ranger Postgres database
I20260805 23:02:52.304837 22709 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-admin
2026-08-05 23:02:52,618 [I] DB FLAVOR :POSTGRES
2026-08-05 23:02:52,618 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 23:02:52,618 [I] Checking connection..
2026-08-05 23:02:52,618 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-05 23:02:52,896 [I] Checking connection passed.
2026-08-05 23:02:52,897 [I] --------- Verifying version history table ---------
2026-08-05 23:02:52,897 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 23:02:53,189 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 23:02:53,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 23:02:53,457 [I] Table x_db_version_h does not exist in database ranger
2026-08-05 23:02:53,457 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-05 23:02:53,457 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-05 23:02:53.731 UTC [6935] WARNING: there is no transaction in progress
2026-08-05 23:02:53,740 [I] create_dbversion_catalog.sql file imported successfully
2026-08-05 23:02:53,740 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-05 23:02:54,022 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-05 23:02:54,023 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 23:02:54,023 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-05 23:02:54,310 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-05 23:02:54,586 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1vmg.c.gcp-upstream.internal','N') ;"
2026-08-05 23:02:54,862 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 23:02:55,150 [I] Table x_portal_user does not exist in database ranger
2026-08-05 23:02:55,150 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 23:02:55,440 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-05 23:02:55,441 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 23:02:55,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 23:02:55,998 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-05 23:02:55,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-05 23:02:57.027 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.045 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.063 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.082 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.104 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.126 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.190 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.198 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.215 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.226 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.237 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.253 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.264 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.271 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.279 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57.287 UTC [7076] WARNING: there is no transaction in progress
2026-08-05 23:02:57,916 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-05 23:02:57,916 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-05 23:02:58,190 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-05 23:02:58,191 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-05 23:02:58,463 [I] Table x_portal_user already exists in database 'ranger'
2026-08-05 23:02:58,464 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-05 23:02:58,733 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-05 23:02:58,734 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-05 23:02:59,008 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-05 23:02:59,272 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1vmg.c.gcp-upstream.internal';"
2026-08-05 23:02:59,523 [I] CORE_DB_SCHEMA import status has been updated
2026-08-05 23:02:59,524 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-05 23:02:59,778 [I] DB_PATCHES have already been applied
I20260805 23:02:59.785009 22709 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-admin:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskNZyF8v/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260805 23:02:59.785113 22709 mini_ranger.cc:193] Using host: 127.22.45.84
I20260805 23:02:59.803934 22709 mini_ranger.cc:227] Ranger admin URL: http://127.22.45.84:33477
Aug 05, 2026 11:03:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 11:03:00 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 11:03:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp
Aug 05, 2026 11:03:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 05, 2026 11:03:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 05, 2026 11:03:00 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-admin/ews/webapp].
Aug 05, 2026 11:03:00 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260805 23:03:01.040366 22709 mini_ranger.cc:160] Time spent starting Ranger: real 9.233s user 0.000s sys 0.059s
Aug 05, 2026 11:03:22 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 05, 2026 11:03:22 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 05, 2026 11:03:22 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 05, 2026 11:03:22 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 05, 2026 11:03:23 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260805 23:03:24.587189 22709 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.45.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.45.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/rangerkms_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.45.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/rangerkms_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.45.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.45.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.45.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/HTTP_127.22.45.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 05 23:03:24 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971004, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260805 23:03:24.813714 22709 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260805 23:03:24.839994 22709 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260805 23:03:25.565286 22709 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260805 23:03:25.565430 22709 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms
I20260805 23:03:25.565472 22709 mini_ranger_kms.cc:227] Using postgres at 127.22.45.84:55779
2026-08-05 23:03:25,947 [I] DB FLAVOR :POSTGRES
2026-08-05 23:03:25,948 [I] --------- Verifying Ranger DB connection ---------
2026-08-05 23:03:25,948 [I] Checking connection
2026-08-05 23:03:25,948 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-05 23:03:26,237 [I] connection success
2026-08-05 23:03:26,237 [I] --------- Verifying Ranger DB tables ---------
2026-08-05 23:03:26,237 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-05 23:03:26,237 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-05 23:03:26,495 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-05 23:03:26,496 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-05 23:03:26,496 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-05 23:03:26,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.45.84:55779/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-05 23:03:26,787 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260805 23:03:27.323733 22709 mini_ranger_kms.cc:310] Created kms service
I20260805 23:03:27.529071 22709 mini_ranger_kms.cc:326] Created kudu user
I20260805 23:03:27.576980 22709 mini_ranger_kms.cc:343] Created rangerkms user
Aug 05 23:03:27 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971004, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:28.012014 22709 mini_ranger_kms.cc:384] Added ranger policy
I20260805 23:03:28.012380 22709 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms:/tmp/dist-test-taskNZyF8v/build/asan/bin/postgresql.jar:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskNZyF8v/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260805 23:03:28.012434 22709 mini_ranger_kms.cc:240] Using host: 127.22.45.84
I20260805 23:03:28.032887 22709 mini_ranger_kms.cc:276] Ranger KMS PID: 7334
I20260805 23:03:28.033037 22709 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.45.84:49959
Aug 05, 2026 11:03:29 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 05, 2026 11:03:29 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 05, 2026 11:03:29 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 05, 2026 11:03:29 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 05, 2026 11:03:29 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-kms/ews/webapp].
Aug 05, 2026 11:03:29 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 05 23:03:30 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785971010, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.45.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:30.479882 22709 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.666s user 0.074s sys 0.342s
I20260805 23:03:30.480122 22709 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260805 23:03:30.480288 22709 mini_ranger_kms.cc:401] 127.22.45.84:49959/kms/v1/keys
Aug 05 23:03:30 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971010, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.45.84@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
Aug 05 23:03:31 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971010, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.45.84@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
Aug 05 23:03:33 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:03:33.810149 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41803
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:41803
--ranger_config_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:34.182737 7399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:34.183187 7399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:34.183331 7399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:34.191217 7399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:34.191365 7399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:34.191414 7399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:34.191493 7399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:34.191563 7399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:34.202678 7399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.45.84:49959/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:41803
--ranger_config_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:34.204310 7399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:34.205824 7399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:34.219110 7404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:34.219139 7408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:34.219170 7405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:34.219671 7399 server_base.cc:1034] running on GCE node
I20260805 23:03:34.220731 7399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:34.222519 7399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:34.223794 7399 hybrid_clock.cc:648] HybridClock initialized: now 1785971014223743 us; error 87 us; skew 500 ppm
I20260805 23:03:34.224218 7399 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:34 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971014, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:34.227891 7399 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:03:34.229666 7399 webserver.cc:460] Webserver started at http://127.22.45.126:38569/ using document root <none> and password file <none>
I20260805 23:03:34.230422 7399 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:34.230542 7399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:34.230841 7399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:03:34 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971014, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:34.296972 7399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "7ca10b30ce974961a8681f2a42410d63"
format_stamp: "Formatted at 2026-08-05 23:03:34 on dist-test-slave-1vmg"
server_key: "5941136ff728b45ed3960c8123dd59bf"
server_key_iv: "7b3f1ea792c72c7ff6864cc5e92b080d"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:34.298237 7399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "7ca10b30ce974961a8681f2a42410d63"
format_stamp: "Formatted at 2026-08-05 23:03:34 on dist-test-slave-1vmg"
server_key: "5941136ff728b45ed3960c8123dd59bf"
server_key_iv: "7b3f1ea792c72c7ff6864cc5e92b080d"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:34.306352 7399 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260805 23:03:34.328240 7418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:34.330173 7399 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:03:34.330430 7399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "7ca10b30ce974961a8681f2a42410d63"
format_stamp: "Formatted at 2026-08-05 23:03:34 on dist-test-slave-1vmg"
server_key: "5941136ff728b45ed3960c8123dd59bf"
server_key_iv: "7b3f1ea792c72c7ff6864cc5e92b080d"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:34.330734 7399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:34.352967 7399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:34.357168 7399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:34.357482 7399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:34.376801 7399 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:41803
I20260805 23:03:34.376811 7495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:41803 every 8 connection(s)
I20260805 23:03:34.378418 7399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:03:34.381644 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 7399
I20260805 23:03:34.381862 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:03:34.382560 22709 external_mini_cluster.cc:1428] Setting key 736b3945dd029e74f9bc26ab09f77395
I20260805 23:03:34.383098 7496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:34.396445 7496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Bootstrap starting.
Aug 05 23:03:34 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:34.400506 7496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:34.402009 7496 log.cc:824] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:34.406071 7496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: No bootstrap required, opened a new log
I20260805 23:03:34.407979 7502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:34.384864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40100 (local address 127.22.45.126:41803)
0805 23:03:34.385698 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:34.385710 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:34.385756 (+ 46us) server_negotiation.cc:407] Connection header received
0805 23:03:34.388209 (+ 2453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:34.388237 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:34.388712 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:34.389145 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:34.390629 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:34.392041 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:34.393413 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:34.394256 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:34.394446 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:34.398695 (+ 4249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:34.398708 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:34.398730 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:34.398793 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:34.402781 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:34.403844 (+ 1063us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:34.403854 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:34.403864 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:34.404089 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:34.404461 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:34.404466 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:34.404469 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:34.405248 (+ 779us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:34.405559 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:34.405913 (+ 354us) server_negotiation.cc:299] Negotiation successful
0805 23:03:34.406399 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":383,"threads_started":1}
I20260805 23:03:34.415889 7496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:34.416471 7496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:34.416615 7496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca10b30ce974961a8681f2a42410d63, State: Initialized, Role: FOLLOWER
I20260805 23:03:34.417343 7496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:34.417625 7496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:03:34.417768 7496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:03:34.417938 7496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:34.420387 7496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:34.420990 7496 leader_election.cc:302] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ca10b30ce974961a8681f2a42410d63; no voters:
I20260805 23:03:34.421674 7496 leader_election.cc:288] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:03:34.421829 7504 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:03:34.423000 7504 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 LEADER]: Becoming Leader. State: Replica: 7ca10b30ce974961a8681f2a42410d63, State: Running, Role: LEADER
I20260805 23:03:34.424053 7496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:34.424000 7504 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:34.427273 7506 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ca10b30ce974961a8681f2a42410d63. Latest consensus state: current_term: 1 leader_uuid: "7ca10b30ce974961a8681f2a42410d63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } } }
I20260805 23:03:34.427791 7506 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:34.427341 7505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ca10b30ce974961a8681f2a42410d63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } } }
I20260805 23:03:34.428047 7505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:34.432260 7516 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:03:34.437996 7516 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:03:34.438947 7496 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 23:03:34.459424 7516 catalog_manager.cc:1347] Generated new cluster ID: f469bfe5d4a04a14bc353e510e98abe1
I20260805 23:03:34.459710 7516 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:03:34.489604 7516 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:03:34.491792 7516 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:03:34.500955 7516 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Generated new TSK 0
I20260805 23:03:34.502306 7516 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:03:35.286206 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41803
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:03:35 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785971015, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260805 23:03:35.709709 7551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:35.710065 7551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:35.710266 7551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:35.718356 7551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:35.718506 7551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:35.718708 7551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:03:35.729589 7551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.45.84:49959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:35.731065 7551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:35.732461 7551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:35.751318 7565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:35.757853 7551 server_base.cc:1034] running on GCE node
W20260805 23:03:35.758453 7569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:35.758594 7566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:35.759514 7551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:35.760761 7551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:35.762042 7551 hybrid_clock.cc:648] HybridClock initialized: now 1785971015761978 us; error 66 us; skew 500 ppm
I20260805 23:03:35.762439 7551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:35 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971015, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:35.766477 7551 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:03:35.770367 7551 webserver.cc:460] Webserver started at http://127.22.45.65:42431/ using document root <none> and password file <none>
I20260805 23:03:35.771251 7551 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:35.771390 7551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:35.771733 7551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:03:35 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971015, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:35.793008 7551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "0716975df50a4c2296ce8af8b403fb8d"
format_stamp: "Formatted at 2026-08-05 23:03:35 on dist-test-slave-1vmg"
server_key: "513c51a076dd5f347fd3cc19cab421d8"
server_key_iv: "8f98d634ddb160948529de78f787454f"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:35.794428 7551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "0716975df50a4c2296ce8af8b403fb8d"
format_stamp: "Formatted at 2026-08-05 23:03:35 on dist-test-slave-1vmg"
server_key: "513c51a076dd5f347fd3cc19cab421d8"
server_key_iv: "8f98d634ddb160948529de78f787454f"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:35.813694 7551 fs_manager.cc:691] Time spent creating directory manager: real 0.019s user 0.002s sys 0.013s
I20260805 23:03:35.851747 7583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:35.853998 7551 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.007s sys 0.007s
I20260805 23:03:35.854301 7551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "0716975df50a4c2296ce8af8b403fb8d"
format_stamp: "Formatted at 2026-08-05 23:03:35 on dist-test-slave-1vmg"
server_key: "513c51a076dd5f347fd3cc19cab421d8"
server_key_iv: "8f98d634ddb160948529de78f787454f"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:35.854656 7551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:35.900846 7551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:35.905568 7551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:35.905936 7551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:35.907176 7551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:35.909049 7551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:35.909185 7551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:35.909333 7551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:35.909394 7551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:35.985421 7551 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:43827
I20260805 23:03:35.985462 7744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:43827 every 8 connection(s)
I20260805 23:03:35.987458 7551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:03:35.988229 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 7551
I20260805 23:03:35.988433 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:03:35.989259 22709 external_mini_cluster.cc:1428] Setting key 7b167b8a5cf7751e55f9e633e09e0bf2
Aug 05 23:03:36 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971015, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:36.048879 7748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:35.998254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:32927 (local address 127.22.45.126:41803)
0805 23:03:36.020488 (+ 22234us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:36.020495 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:36.021602 (+ 1107us) server_negotiation.cc:407] Connection header received
0805 23:03:36.027036 (+ 5434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:36.027042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:36.027215 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:36.027361 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:36.030871 (+ 3510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.032212 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.034902 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.035625 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.035738 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:36.040756 (+ 5018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:36.040764 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:36.040770 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:36.040832 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:36.044619 (+ 3787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:36.045769 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:36.045776 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:36.045780 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:36.045955 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:36.046577 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:36.046583 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:36.046587 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:36.046989 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:36.047123 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:36.048196 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0805 23:03:36.048471 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22068,"thread_start_us":22251,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:03:36.051944 7747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:35.997522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41803 (local address 127.22.45.65:32927)
0805 23:03:36.021338 (+ 23816us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:36.021422 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:36.026252 (+ 4830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:36.028835 (+ 2583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:36.028850 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:36.029606 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:36.030582 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:36.030616 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.032469 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.032476 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:36.034668 (+ 2192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:36.034691 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.036174 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.036181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:36.036512 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:36.037427 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:36.037460 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:36.040412 (+ 2952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:36.044882 (+ 4470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:36.044894 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:36.044918 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:36.045603 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:36.046120 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:36.046125 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:36.046129 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:36.046438 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:36.047238 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:36.047247 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:36.047734 (+ 487us) client_negotiation.cc:769] Sending connection context
0805 23:03:36.049640 (+ 1906us) client_negotiation.cc:240] Negotiation successful
0805 23:03:36.050317 (+ 677us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23396,"thread_start_us":26412,"threads_started":1}
I20260805 23:03:36.054378 7746 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41803
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
I20260805 23:03:36.054795 7746 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:36.055840 7746 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
I20260805 23:03:36.059028 7444 ts_manager.cc:194] Registered new tserver with Master: 0716975df50a4c2296ce8af8b403fb8d (127.22.45.65:43827)
I20260805 23:03:36.061337 7444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:32927
Aug 05 23:03:36 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971015, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
W20260805 23:03:36.110270 22709 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.22.45.66: real 0.114s user 0.000s sys 0.024s
I20260805 23:03:36.111451 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41803
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:03:36 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971015, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
W20260805 23:03:36.627772 7752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:36.628350 7752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:36.628576 7752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:36.642805 7752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:36.643131 7752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:36.643402 7752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:03:36.659989 7752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.45.84:49959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:36.662146 7752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:36.664139 7752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:36.698602 7766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:36.701503 7767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:36.703462 7752 server_base.cc:1034] running on GCE node
W20260805 23:03:36.705986 7769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:36.707069 7752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:36.708544 7752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:36.711997 7752 hybrid_clock.cc:648] HybridClock initialized: now 1785971016711918 us; error 69 us; skew 500 ppm
I20260805 23:03:36.712495 7752 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:36 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971016, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:36.722266 7752 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:03:36.724781 7752 webserver.cc:460] Webserver started at http://127.22.45.66:45583/ using document root <none> and password file <none>
I20260805 23:03:36.725841 7752 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:36.725996 7752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:36.726363 7752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:03:36 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971016, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:36.761813 7752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb"
format_stamp: "Formatted at 2026-08-05 23:03:36 on dist-test-slave-1vmg"
server_key: "cff1a2c74e5e434180a8d2765d5b8d4b"
server_key_iv: "c76e3bed9560d3885f273cb27754d569"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:36.763378 7752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb"
format_stamp: "Formatted at 2026-08-05 23:03:36 on dist-test-slave-1vmg"
server_key: "cff1a2c74e5e434180a8d2765d5b8d4b"
server_key_iv: "c76e3bed9560d3885f273cb27754d569"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:36.778664 7752 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.009s sys 0.005s
I20260805 23:03:36.803287 7791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:36.805625 7752 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.007s sys 0.001s
I20260805 23:03:36.805891 7752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb"
format_stamp: "Formatted at 2026-08-05 23:03:36 on dist-test-slave-1vmg"
server_key: "cff1a2c74e5e434180a8d2765d5b8d4b"
server_key_iv: "c76e3bed9560d3885f273cb27754d569"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:36.806210 7752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:36.833719 7752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:36.839933 7752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:36.840350 7752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:36.841740 7752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:36.843844 7752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:36.843990 7752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:36.844151 7752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:36.844219 7752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:36.880990 7752 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:34281
I20260805 23:03:36.880991 7955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:34281 every 8 connection(s)
I20260805 23:03:36.882896 7752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:03:36.889871 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 7752
I20260805 23:03:36.890084 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:03:36.890656 22709 external_mini_cluster.cc:1428] Setting key e5db88ed6474696baa82f85c7771a761
Aug 05 23:03:36 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971016, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:36.910627 7959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:36.886269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:41541 (local address 127.22.45.126:41803)
0805 23:03:36.886740 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:36.886745 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:36.888235 (+ 1490us) server_negotiation.cc:407] Connection header received
0805 23:03:36.890580 (+ 2345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:36.890587 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:36.890704 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:36.890828 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:36.892759 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.893736 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.896418 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.897003 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.897150 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:36.902174 (+ 5024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:36.902182 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:36.902187 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:36.902241 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:36.906143 (+ 3902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:36.907460 (+ 1317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:36.907468 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:36.907471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:36.907661 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:36.908293 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:36.908299 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:36.908303 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:36.908732 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:36.908905 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:36.909939 (+ 1034us) server_negotiation.cc:299] Negotiation successful
0805 23:03:36.910246 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":246,"threads_started":1}
I20260805 23:03:36.912194 7960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:36.887230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41803 (local address 127.22.45.66:41541)
0805 23:03:36.888053 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:36.888101 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:36.890155 (+ 2054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:36.891193 (+ 1038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:36.891206 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:36.891829 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:36.892557 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:36.892579 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.893933 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.893940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:36.896201 (+ 2261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:36.896223 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:36.897301 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:36.897310 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:36.897641 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:36.898537 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:36.898571 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:36.901759 (+ 3188us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:36.906408 (+ 4649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:36.906420 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:36.906443 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:36.907280 (+ 837us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:36.907800 (+ 520us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:36.907805 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:36.907808 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:36.908147 (+ 339us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:36.908902 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:36.908911 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:36.909421 (+ 510us) client_negotiation.cc:769] Sending connection context
0805 23:03:36.909755 (+ 334us) client_negotiation.cc:240] Negotiation successful
0805 23:03:36.910412 (+ 657us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":332,"threads_started":1}
I20260805 23:03:36.913969 7957 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41803
I20260805 23:03:36.914353 7957 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:36.915391 7957 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
I20260805 23:03:36.917416 7444 ts_manager.cc:194] Registered new tserver with Master: d7b49c3bbe6a4482bf9dd417f5dac8bb (127.22.45.66:34281)
I20260805 23:03:36.918642 7444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:41541
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:03:36.956626 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41803
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:03:37.065994 7746 heartbeater.cc:503] Master 127.22.45.126:41803 was elected leader, sending a full tablet report...
W20260805 23:03:37.330438 7964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:37.330902 7964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:37.331099 7964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:37.342564 7964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:37.342720 7964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:37.342883 7964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:03:37.353881 7964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.45.84:49959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:41803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:37.355461 7964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:37.356935 7964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:37.371169 7969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:37.371181 7972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:37.371404 7970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:37.372747 7964 server_base.cc:1034] running on GCE node
I20260805 23:03:37.373437 7964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:37.374591 7964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:37.375862 7964 hybrid_clock.cc:648] HybridClock initialized: now 1785971017375788 us; error 87 us; skew 500 ppm
I20260805 23:03:37.376256 7964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:37 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971017, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:37.380687 7964 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:03:37.384398 7964 webserver.cc:460] Webserver started at http://127.22.45.67:46847/ using document root <none> and password file <none>
I20260805 23:03:37.385321 7964 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:37.385491 7964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:37.385861 7964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 05 23:03:37 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971017, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:37.401727 7964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "5dc84027369b4ae2a16d1e5be9b19d5c"
format_stamp: "Formatted at 2026-08-05 23:03:37 on dist-test-slave-1vmg"
server_key: "277d8e4052fd7383d62b48e461551bd9"
server_key_iv: "06c5f63d52a4c3e904e516ad04d9ef69"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:37.402668 7964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "5dc84027369b4ae2a16d1e5be9b19d5c"
format_stamp: "Formatted at 2026-08-05 23:03:37 on dist-test-slave-1vmg"
server_key: "277d8e4052fd7383d62b48e461551bd9"
server_key_iv: "06c5f63d52a4c3e904e516ad04d9ef69"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:37.408656 7964 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260805 23:03:37.425743 7982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:37.427960 7964 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:03:37.428210 7964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "5dc84027369b4ae2a16d1e5be9b19d5c"
format_stamp: "Formatted at 2026-08-05 23:03:37 on dist-test-slave-1vmg"
server_key: "277d8e4052fd7383d62b48e461551bd9"
server_key_iv: "06c5f63d52a4c3e904e516ad04d9ef69"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:37.428514 7964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:37.471272 7964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:37.475518 7964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:37.475862 7964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:37.476963 7964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:37.478574 7964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:37.478665 7964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:37.478771 7964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:37.478830 7964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:37.510782 7964 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:38349
I20260805 23:03:37.510823 8143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:38349 every 8 connection(s)
I20260805 23:03:37.512161 7964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:03:37.514880 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 7964
I20260805 23:03:37.515130 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:03:37.515692 22709 external_mini_cluster.cc:1428] Setting key 0d57a46a78d759a9fc0162ce4b7f31f3
Aug 05 23:03:37 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971017, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:37.534304 8146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:37.515042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:57019 (local address 127.22.45.126:41803)
0805 23:03:37.515591 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:37.515596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:37.517209 (+ 1613us) server_negotiation.cc:407] Connection header received
0805 23:03:37.519205 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:37.519211 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:37.519303 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:37.519399 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:37.521084 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.521813 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.523567 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.524114 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.524238 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:37.527929 (+ 3691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:37.527935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:37.527938 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:37.527977 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:37.530989 (+ 3012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.531837 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.531842 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.531845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.532006 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.532469 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.532472 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.532475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.532835 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:37.532957 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:37.533817 (+ 860us) server_negotiation.cc:299] Negotiation successful
0805 23:03:37.534036 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":275,"threads_started":1}
I20260805 23:03:37.535379 8147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:37.515822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41803 (local address 127.22.45.67:57019)
0805 23:03:37.516767 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:37.516810 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:37.518854 (+ 2044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:37.519685 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:37.519696 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:37.520225 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:37.520886 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:37.520905 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.521992 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.521997 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:37.523383 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:37.523423 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.524364 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.524372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:37.524623 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:37.525396 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:37.525422 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:37.527644 (+ 2222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:37.531138 (+ 3494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:37.531148 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:37.531170 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:37.531712 (+ 542us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:37.532136 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:37.532140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:37.532142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:37.532374 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:37.532986 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:37.532994 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:37.533400 (+ 406us) client_negotiation.cc:769] Sending connection context
0805 23:03:37.533711 (+ 311us) client_negotiation.cc:240] Negotiation successful
0805 23:03:37.534183 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":356,"threads_started":1}
I20260805 23:03:37.536777 8144 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41803
I20260805 23:03:37.537103 8144 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:37.537899 8144 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
I20260805 23:03:37.539496 7444 ts_manager.cc:194] Registered new tserver with Master: 5dc84027369b4ae2a16d1e5be9b19d5c (127.22.45.67:38349)
I20260805 23:03:37.540386 7444 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:57019
I20260805 23:03:37.544603 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:03:37.546355 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 7551
Aug 05 23:03:37 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:03:37.564052 8149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:37.547505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47830 (local address 127.22.45.65:43827)
0805 23:03:37.548132 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:37.548139 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:37.548165 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:03:37.548228 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:37.548235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:37.548456 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:37.548588 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:37.550104 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.551232 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.552677 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.553262 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.553361 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:37.558355 (+ 4994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:37.558378 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:37.558400 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:37.558457 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:37.561385 (+ 2928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.562106 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.562114 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.562116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.562287 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.562587 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.562590 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.562591 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.562986 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:37.563253 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:37.563459 (+ 206us) server_negotiation.cc:299] Negotiation successful
0805 23:03:37.563690 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":292,"threads_started":1}
I20260805 23:03:37.565480 7738 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:37.649823 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 7551
I20260805 23:03:37.672749 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 7752
Aug 05 23:03:37 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:03:37.689491 8152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:37.673843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45606 (local address 127.22.45.66:34281)
0805 23:03:37.674430 (+ 587us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:37.674437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:37.674467 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:03:37.674536 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:37.674542 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:37.674788 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:37.674957 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:37.676265 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.677329 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.678834 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.679506 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.679620 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:37.683909 (+ 4289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:37.683924 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:37.683940 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:37.683981 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:37.686751 (+ 2770us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.687510 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.687518 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.687520 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.687664 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.687973 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.687976 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.687978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.688345 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:37.688564 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:37.688830 (+ 266us) server_negotiation.cc:299] Negotiation successful
0805 23:03:37.689077 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":314,"threads_started":1}
I20260805 23:03:37.690871 7951 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:37.773237 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 7752
I20260805 23:03:37.795809 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 7964
Aug 05 23:03:37 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:03:37.813262 8155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:37.796973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39318 (local address 127.22.45.67:38349)
0805 23:03:37.797650 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:37.797658 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:37.797688 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:03:37.797754 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:37.797760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:37.797990 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:37.798125 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:37.799770 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.800835 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.802253 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:37.803096 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:37.803236 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:37.807921 (+ 4685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:37.807936 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:37.807952 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:37.808001 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:37.810827 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.811523 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.811531 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.811533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.811671 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:37.811977 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:37.811980 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:37.811981 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:37.812320 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:37.812574 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:37.812761 (+ 187us) server_negotiation.cc:299] Negotiation successful
0805 23:03:37.812973 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":372,"threads_started":1}
I20260805 23:03:37.814829 8139 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:37.900241 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 7964
I20260805 23:03:37.921382 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 7399
I20260805 23:03:37.922837 7489 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:38.044269 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 7399
I20260805 23:03:38.084762 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41803
--webserver_interface=127.22.45.126
--webserver_port=38569
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:41803
--ranger_config_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:38.440274 8159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:38.440618 8159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:38.440737 8159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:38.448407 8159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:38.448547 8159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:38.448623 8159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:38.448705 8159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:38.448776 8159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:38.459408 8159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:41803
--ranger_config_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41803
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=38569
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:38.460829 8159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:38.462210 8159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:38.474786 8165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:38.474750 8169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:38.474756 8166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:38.476073 8159 server_base.cc:1034] running on GCE node
I20260805 23:03:38.476980 8159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:38.478600 8159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:38.479844 8159 hybrid_clock.cc:648] HybridClock initialized: now 1785971018479792 us; error 54 us; skew 500 ppm
I20260805 23:03:38.480242 8159 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:38 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971018, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:38.483708 8159 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:03:38.485464 8159 webserver.cc:460] Webserver started at http://127.22.45.126:38569/ using document root <none> and password file <none>
I20260805 23:03:38.486157 8159 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:38.486294 8159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 23:03:38 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971018, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:38.565412 8159 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260805 23:03:38.569139 8178 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:38.570819 8159 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 23:03:38.571091 8159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "7ca10b30ce974961a8681f2a42410d63"
format_stamp: "Formatted at 2026-08-05 23:03:34 on dist-test-slave-1vmg"
server_key: "5941136ff728b45ed3960c8123dd59bf"
server_key_iv: "7b3f1ea792c72c7ff6864cc5e92b080d"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:38.572228 8159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:38.586834 8159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:38.590986 8159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:38.591300 8159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:38.610275 8159 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:41803
I20260805 23:03:38.610301 8258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:41803 every 8 connection(s)
I20260805 23:03:38.612111 8159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:03:38.616945 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 8159
I20260805 23:03:38.617911 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:43827
--local_ip_for_outbound_sockets=127.22.45.65
--tserver_master_addrs=127.22.45.126:41803
--webserver_port=42431
--webserver_interface=127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:03:38.619985 8259 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:03:38.623644 8259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Bootstrap starting.
I20260805 23:03:38.642886 8259 log.cc:824] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:38.654081 8259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:03:38.654743 8259 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Bootstrap complete.
I20260805 23:03:38.664439 8259 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:38.665428 8259 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ca10b30ce974961a8681f2a42410d63, State: Initialized, Role: FOLLOWER
I20260805 23:03:38.666126 8259 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:38.666373 8259 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:03:38.666495 8259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:03:38.666671 8259 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 1 FOLLOWER]: Advancing to term 2
I20260805 23:03:38.671167 8259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:38.671761 8259 leader_election.cc:302] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ca10b30ce974961a8681f2a42410d63; no voters:
I20260805 23:03:38.672418 8259 leader_election.cc:288] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 23:03:38.672622 8268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 23:03:38.673846 8268 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [term 2 LEADER]: Becoming Leader. State: Replica: 7ca10b30ce974961a8681f2a42410d63, State: Running, Role: LEADER
I20260805 23:03:38.674535 8268 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } }
I20260805 23:03:38.675038 8259 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:38.677690 8272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ca10b30ce974961a8681f2a42410d63. Latest consensus state: current_term: 2 leader_uuid: "7ca10b30ce974961a8681f2a42410d63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } } }
I20260805 23:03:38.678112 8272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:38.678632 8270 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7ca10b30ce974961a8681f2a42410d63" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ca10b30ce974961a8681f2a42410d63" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41803 } } }
I20260805 23:03:38.678953 8270 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:38.682349 8276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:03:38.689028 8276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:03:38.690691 8276 catalog_manager.cc:1259] Loaded cluster ID: f469bfe5d4a04a14bc353e510e98abe1
I20260805 23:03:38.690907 8276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:03:38.695556 8259 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260805 23:03:38.696375 8276 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:03:38.698221 8276 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Loaded TSK: 0
I20260805 23:03:38.700366 8276 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 23:03:39.142165 8266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:39.142668 8266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:39.142853 8266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:39.155092 8266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:39.155268 8266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:39.155452 8266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:03:39.171384 8266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:43827
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=42431
--tserver_master_addrs=127.22.45.126:41803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:39.173314 8266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:39.175189 8266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:39.197942 8310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:39.198055 8314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:39.197960 8311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:39.199867 8266 server_base.cc:1034] running on GCE node
I20260805 23:03:39.200699 8266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:39.201858 8266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:39.203085 8266 hybrid_clock.cc:648] HybridClock initialized: now 1785971019203035 us; error 57 us; skew 500 ppm
I20260805 23:03:39.203442 8266 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:39 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971019, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:39.207702 8266 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:03:39.216647 8266 webserver.cc:460] Webserver started at http://127.22.45.65:42431/ using document root <none> and password file <none>
I20260805 23:03:39.217567 8266 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:39.217738 8266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 23:03:39 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971019, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:39.271813 8266 fs_manager.cc:709] Time spent opening directory manager: real 0.029s user 0.016s sys 0.012s
I20260805 23:03:39.276114 8323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:39.278301 8266 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:03:39.278573 8266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "0716975df50a4c2296ce8af8b403fb8d"
format_stamp: "Formatted at 2026-08-05 23:03:35 on dist-test-slave-1vmg"
server_key: "513c51a076dd5f347fd3cc19cab421d8"
server_key_iv: "8f98d634ddb160948529de78f787454f"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:39.280239 8266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:39.311241 8266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:39.316883 8266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:39.317287 8266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:39.318511 8266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:39.320329 8266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:39.320449 8266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:39.320576 8266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:39.320659 8266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:39.409322 8266 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:43827
I20260805 23:03:39.409374 8486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:43827 every 8 connection(s)
I20260805 23:03:39.410880 8266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:03:39.420105 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 8266
I20260805 23:03:39.421022 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:34281
--local_ip_for_outbound_sockets=127.22.45.66
--tserver_master_addrs=127.22.45.126:41803
--webserver_port=45583
--webserver_interface=127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:03:39 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971019, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:39.443388 8490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:39.414952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41803 (local address 127.22.45.65:52767)
0805 23:03:39.415801 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:39.415841 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:39.417865 (+ 2024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:39.420647 (+ 2782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:39.420661 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:39.421767 (+ 1106us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:39.422721 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:39.422755 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:39.424996 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:39.425000 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:39.426308 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:39.426324 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:39.428535 (+ 2211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:39.428545 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:39.428874 (+ 329us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:39.429716 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:39.429751 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:39.432699 (+ 2948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:39.437600 (+ 4901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:39.437611 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:39.437629 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:39.438308 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:39.438955 (+ 647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:39.438960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:39.438964 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:39.439237 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:39.440436 (+ 1199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:39.440445 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:39.440891 (+ 446us) client_negotiation.cc:769] Sending connection context
0805 23:03:39.441192 (+ 301us) client_negotiation.cc:240] Negotiation successful
0805 23:03:39.441863 (+ 671us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":369,"threads_started":1}
I20260805 23:03:39.443441 8489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:39.414653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:52767 (local address 127.22.45.126:41803)
0805 23:03:39.415423 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:39.415445 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:39.415995 (+ 550us) server_negotiation.cc:407] Connection header received
0805 23:03:39.418704 (+ 2709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:39.418725 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:39.419357 (+ 632us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:39.419832 (+ 475us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:39.423095 (+ 3263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:39.424757 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:39.426509 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:39.427804 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:39.428044 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:39.433090 (+ 5046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:39.433115 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:39.433138 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:39.433209 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:39.437367 (+ 4158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:39.438501 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:39.438513 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:39.438521 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:39.438759 (+ 238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:39.439377 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:39.439382 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:39.439385 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:39.440251 (+ 866us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:39.440460 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:39.441523 (+ 1063us) server_negotiation.cc:299] Negotiation successful
0805 23:03:39.442015 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":310,"threads_started":1}
I20260805 23:03:39.447703 8487 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41803
I20260805 23:03:39.448108 8487 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:39.449165 8487 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
W20260805 23:03:39.453496 8487 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:41803 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 23:03:39.453764 8487 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:39.454073 8487 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
I20260805 23:03:39.455622 8487 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:39.456043 8487 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
W20260805 23:03:39.457336 8487 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 23:03:39.873601 8491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:39.873967 8491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:39.874123 8491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:39.882695 8491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:39.883004 8491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:39.883287 8491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:03:39.900728 8491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:34281
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=45583
--tserver_master_addrs=127.22.45.126:41803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:39.902865 8491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:39.904858 8491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:39.925976 8514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:39.926862 8513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:39.933467 8516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:39.936035 8491 server_base.cc:1034] running on GCE node
I20260805 23:03:39.937279 8491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:39.946259 8491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:39.947676 8491 hybrid_clock.cc:648] HybridClock initialized: now 1785971019947604 us; error 90 us; skew 500 ppm
I20260805 23:03:39.948096 8491 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:39 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971019, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:39.951719 8491 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:03:39.954447 8491 webserver.cc:460] Webserver started at http://127.22.45.66:45583/ using document root <none> and password file <none>
I20260805 23:03:39.955425 8491 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:39.955590 8491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 23:03:39 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971019, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:39.977895 8491 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.000s sys 0.004s
I20260805 23:03:39.980919 8526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:39.982432 8491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 23:03:39.982726 8491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb"
format_stamp: "Formatted at 2026-08-05 23:03:36 on dist-test-slave-1vmg"
server_key: "cff1a2c74e5e434180a8d2765d5b8d4b"
server_key_iv: "c76e3bed9560d3885f273cb27754d569"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:39.984028 8491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:40.006038 8491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:40.010739 8491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:40.011101 8491 kserver.cc:163] Server-wide thread pool size limit: 3276
Aug 05 23:03:40 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1785971020, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:40.012281 8491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:40.013820 8491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:40.013912 8491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:40.013999 8491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:40.014055 8491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:40.084206 8491 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:34281
I20260805 23:03:40.084384 8688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:34281 every 8 connection(s)
I20260805 23:03:40.085969 8491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:03:40.090642 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 8491
I20260805 23:03:40.091550 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.45.84:49959/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:38349
--local_ip_for_outbound_sockets=127.22.45.67
--tserver_master_addrs=127.22.45.126:41803
--webserver_port=46847
--webserver_interface=127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40381
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:03:40 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971019, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:40.124887 8693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:40.090107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41803 (local address 127.22.45.66:54879)
0805 23:03:40.097223 (+ 7116us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:40.097304 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:40.099526 (+ 2222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:40.101589 (+ 2063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:40.101603 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:40.102255 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:40.103203 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:40.103245 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:40.105016 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:40.105022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:40.106902 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:40.106953 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:40.108133 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:40.108140 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:40.108452 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:40.109394 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:40.109425 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:40.112493 (+ 3068us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:40.118417 (+ 5924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:40.118430 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:40.118452 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:40.119326 (+ 874us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:40.120046 (+ 720us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:40.120052 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:40.120056 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:40.120398 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:40.121334 (+ 936us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:40.121346 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:40.121898 (+ 552us) client_negotiation.cc:769] Sending connection context
0805 23:03:40.122287 (+ 389us) client_negotiation.cc:240] Negotiation successful
0805 23:03:40.123088 (+ 801us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6738,"thread_start_us":6460,"threads_started":1}
I20260805 23:03:40.127024 8692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:40.089434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:54879 (local address 127.22.45.126:41803)
0805 23:03:40.100800 (+ 11366us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:40.100807 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:40.100834 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:03:40.100914 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:40.100920 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:40.101022 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:40.101171 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:40.103511 (+ 2340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:40.104765 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:40.107159 (+ 2394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:40.107836 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:40.109001 (+ 1165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:40.112866 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:40.112873 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:40.112877 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:40.112925 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:40.118139 (+ 5214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:40.119604 (+ 1465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:40.119611 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:40.119614 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:40.119853 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:40.120633 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:40.120639 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:40.120643 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:40.121120 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:40.125978 (+ 4858us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:40.126200 (+ 222us) server_negotiation.cc:299] Negotiation successful
0805 23:03:40.126529 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11210,"thread_start_us":11053,"threads_started":1}
I20260805 23:03:40.128731 8689 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41803
I20260805 23:03:40.129142 8689 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:40.130295 8689 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
I20260805 23:03:40.132956 8207 ts_manager.cc:194] Registered new tserver with Master: d7b49c3bbe6a4482bf9dd417f5dac8bb (127.22.45.66:34281)
I20260805 23:03:40.135468 8207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:54879
I20260805 23:03:40.457496 8487 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:40.458015 8487 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
I20260805 23:03:40.459489 8207 ts_manager.cc:194] Registered new tserver with Master: 0716975df50a4c2296ce8af8b403fb8d (127.22.45.65:43827)
I20260805 23:03:40.460752 8207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:52767
Aug 05 23:03:40 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971020, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
W20260805 23:03:40.608572 8695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:40.609025 8695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:40.609174 8695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:40.620788 8695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:40.620956 8695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:40.621125 8695 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:03:40.635921 8695 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40381
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.45.84:49959/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:38349
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=46847
--tserver_master_addrs=127.22.45.126:41803
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:40.637450 8695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:40.638887 8695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:40.673324 8702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:40.674675 8701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:40.678983 8695 server_base.cc:1034] running on GCE node
W20260805 23:03:40.679271 8706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:40.680104 8695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:40.689391 8695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:40.690865 8695 hybrid_clock.cc:648] HybridClock initialized: now 1785971020690764 us; error 114 us; skew 500 ppm
I20260805 23:03:40.691334 8695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:40 dist-test-slave-1vmg krb5kdc[6799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971020, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:40.695727 8695 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:03:40.720585 8695 webserver.cc:460] Webserver started at http://127.22.45.67:46847/ using document root <none> and password file <none>
I20260805 23:03:40.721776 8695 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:40.722023 8695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 05 23:03:40 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971020, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:40.767333 8695 fs_manager.cc:709] Time spent opening directory manager: real 0.018s user 0.008s sys 0.007s
I20260805 23:03:40.783473 8717 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:40.785840 8695 fs_manager.cc:725] Time spent opening block manager: real 0.016s user 0.011s sys 0.004s
I20260805 23:03:40.786101 8695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "5dc84027369b4ae2a16d1e5be9b19d5c"
format_stamp: "Formatted at 2026-08-05 23:03:37 on dist-test-slave-1vmg"
server_key: "277d8e4052fd7383d62b48e461551bd9"
server_key_iv: "06c5f63d52a4c3e904e516ad04d9ef69"
server_key_version: "kuduclusterkey@0"
I20260805 23:03:40.787695 8695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:40.851507 8695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:40.858727 8695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:40.859122 8695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:40.866900 8695 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:40.873974 8695 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:40.874174 8695 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:40.874325 8695 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:40.874423 8695 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 05 23:03:40 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971020, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for HTTP/127.22.45.84@KRBTEST.COM
I20260805 23:03:41.122575 8695 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:38349
I20260805 23:03:41.122610 8884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:38349 every 8 connection(s)
I20260805 23:03:41.124596 8695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:03:41.132551 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 8695
I20260805 23:03:41.141228 8689 heartbeater.cc:503] Master 127.22.45.126:41803 was elected leader, sending a full tablet report...
Aug 05 23:03:41 dist-test-slave-1vmg krb5kdc[6799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971020, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:41.162019 8889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.127917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:36089 (local address 127.22.45.126:41803)
0805 23:03:41.131585 (+ 3668us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.131593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.138458 (+ 6865us) server_negotiation.cc:407] Connection header received
0805 23:03:41.138565 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.138571 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.138729 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.138858 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:41.142810 (+ 3952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.144026 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.146511 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.147212 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.147338 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.152512 (+ 5174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:41.152521 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:41.152529 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:41.152604 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:41.156457 (+ 3853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.157745 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.157752 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.157756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.157933 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.158558 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.158563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.158566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.159008 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:41.159155 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.161358 (+ 2203us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.161620 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3485,"thread_start_us":3309,"threads_started":1}
I20260805 23:03:41.164104 8890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.128614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:41803 (local address 127.22.45.67:36089)
0805 23:03:41.135233 (+ 6619us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.135301 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:41.138107 (+ 2806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:41.139442 (+ 1335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:41.139456 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:41.140243 (+ 787us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:41.142526 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.142577 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.144242 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.144248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.146307 (+ 2059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.146328 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.147707 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.147716 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.148069 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.148849 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:41.148891 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:41.152152 (+ 3261us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:41.156759 (+ 4607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:41.156770 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:41.156793 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:41.157536 (+ 743us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:41.158092 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:41.158097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:41.158101 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:41.158394 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:41.159252 (+ 858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:41.159261 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:41.159812 (+ 551us) client_negotiation.cc:769] Sending connection context
0805 23:03:41.160155 (+ 343us) client_negotiation.cc:240] Negotiation successful
0805 23:03:41.160790 (+ 635us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4236,"thread_start_us":4530,"threads_started":1}
I20260805 23:03:41.164263 8892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.133706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40740 (local address 127.22.45.126:41803)
0805 23:03:41.139109 (+ 5403us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.139114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.139930 (+ 816us) server_negotiation.cc:407] Connection header received
0805 23:03:41.139999 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.140004 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.140125 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.140239 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:41.142565 (+ 2326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.143848 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.145842 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.146506 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.146627 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.150616 (+ 3989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:41.150624 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:41.150630 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:41.150677 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:41.160043 (+ 9366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.161079 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.161084 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.161087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.161246 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.161748 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.161753 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.161757 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.162123 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:41.162390 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.163665 (+ 1275us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.163904 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5222,"thread_start_us":5023,"threads_started":1}
I20260805 23:03:41.167027 8887 heartbeater.cc:347] Connected to a master server at 127.22.45.126:41803
I20260805 23:03:41.167441 8887 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:41.168498 8887 heartbeater.cc:511] Master 127.22.45.126:41803 requested a full tablet report, sending...
I20260805 23:03:41.171751 8207 ts_manager.cc:194] Registered new tserver with Master: 5dc84027369b4ae2a16d1e5be9b19d5c (127.22.45.67:38349)
I20260805 23:03:41.172957 8207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:36089
I20260805 23:03:41.184218 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:03:41.213821 8892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.195261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40756 (local address 127.22.45.126:41803)
0805 23:03:41.195470 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.195476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.196054 (+ 578us) server_negotiation.cc:407] Connection header received
0805 23:03:41.196254 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.196258 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.196330 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.196420 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:41.198629 (+ 2209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.199464 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.201571 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.202241 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.202363 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.206376 (+ 4013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:41.206383 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:41.206389 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:41.206441 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:41.210230 (+ 3789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.211227 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.211233 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.211237 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.211410 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.211914 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.211919 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.211923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.212316 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:41.212534 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.213178 (+ 644us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.213439 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 23:03:41.222370 8207 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:03:41.231552 8207 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:03:41.258242 8918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.248211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:34281 (local address 127.0.0.1:45610)
0805 23:03:41.248716 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.248739 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:41.248837 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:41.250235 (+ 1398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:41.250244 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:41.250278 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:41.250667 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.250681 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.252695 (+ 2014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.252700 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.254627 (+ 1927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.254644 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.256307 (+ 1663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.256315 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.256550 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.256618 (+ 68us) client_negotiation.cc:769] Sending connection context
0805 23:03:41.256736 (+ 118us) client_negotiation.cc:240] Negotiation successful
0805 23:03:41.256949 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":25,"thread_start_us":845,"threads_started":1}
I20260805 23:03:41.258301 8920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.248846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45610 (local address 127.22.45.66:34281)
0805 23:03:41.249529 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.249537 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.249566 (+ 29us) server_negotiation.cc:407] Connection header received
0805 23:03:41.249676 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.249684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.249957 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.250936 (+ 979us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:41.251219 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.252542 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.254797 (+ 2255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.256027 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.257428 (+ 1401us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.257714 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.257792 (+ 78us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.257968 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":339,"threads_started":1}
I20260805 23:03:41.258591 8912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.246330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:38349 (local address 127.0.0.1:39328)
0805 23:03:41.247273 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.247322 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:41.247512 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:41.251198 (+ 3686us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:41.251203 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:41.251226 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:41.251598 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.251610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.253506 (+ 1896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.253512 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.255824 (+ 2312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.255841 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.257751 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.257757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.257917 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.257950 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:03:41.258019 (+ 69us) client_negotiation.cc:240] Negotiation successful
0805 23:03:41.258155 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":55,"thread_start_us":451,"threads_started":1}
I20260805 23:03:41.259186 8915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.246455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47840)
0805 23:03:41.248097 (+ 1642us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.248114 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:41.248220 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:41.251610 (+ 3390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:41.251614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:41.251643 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:41.251984 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.251996 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.254585 (+ 2589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.254590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.256566 (+ 1976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.256578 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.258396 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.258402 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.258582 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.258606 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 23:03:41.258658 (+ 52us) client_negotiation.cc:240] Negotiation successful
0805 23:03:41.258746 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1510,"mutex_wait_us":2,"thread_start_us":1369,"threads_started":1}
I20260805 23:03:41.259577 8916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.246542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39328 (local address 127.22.45.67:38349)
0805 23:03:41.250636 (+ 4094us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.250645 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.250681 (+ 36us) server_negotiation.cc:407] Connection header received
0805 23:03:41.250781 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.250787 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.251018 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.251200 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:41.251832 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.253336 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.256009 (+ 2673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.257491 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.258698 (+ 1207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.258963 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.259050 (+ 87us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.259224 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3901,"thread_start_us":3736,"threads_started":1}
I20260805 23:03:41.260275 8917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.247041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47840 (local address 127.22.45.65:43827)
0805 23:03:41.251059 (+ 4018us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.251067 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.251096 (+ 29us) server_negotiation.cc:407] Connection header received
0805 23:03:41.251188 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.251194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.251405 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.251620 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:41.252254 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.254412 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.256716 (+ 2304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.258117 (+ 1401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.259560 (+ 1443us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.259792 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.259863 (+ 71us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.259998 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3827,"thread_start_us":3638,"threads_started":1}
I20260805 23:03:41.263204 8599 tablet_service.cc:1467] Processing CreateTablet for tablet a797ec7560df4520bdc1fa045db8e1d3 (DEFAULT_TABLE table=test-table [id=807157e0641648c8b25993598be122f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:41.263229 8787 tablet_service.cc:1467] Processing CreateTablet for tablet a797ec7560df4520bdc1fa045db8e1d3 (DEFAULT_TABLE table=test-table [id=807157e0641648c8b25993598be122f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:41.263846 8398 tablet_service.cc:1467] Processing CreateTablet for tablet a797ec7560df4520bdc1fa045db8e1d3 (DEFAULT_TABLE table=test-table [id=807157e0641648c8b25993598be122f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:41.264626 8599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a797ec7560df4520bdc1fa045db8e1d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:41.264691 8787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a797ec7560df4520bdc1fa045db8e1d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:41.265128 8398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a797ec7560df4520bdc1fa045db8e1d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:41.278223 8921 tablet_bootstrap.cc:492] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Bootstrap starting.
I20260805 23:03:41.280802 8923 tablet_bootstrap.cc:492] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Bootstrap starting.
I20260805 23:03:41.282740 8921 tablet_bootstrap.cc:654] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:41.284219 8921 log.cc:824] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:41.285785 8923 tablet_bootstrap.cc:654] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:41.285967 8922 tablet_bootstrap.cc:492] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Bootstrap starting.
I20260805 23:03:41.287271 8923 log.cc:824] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:41.288424 8921 tablet_bootstrap.cc:492] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: No bootstrap required, opened a new log
I20260805 23:03:41.288806 8921 ts_tablet_manager.cc:1397] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260805 23:03:41.290115 8922 tablet_bootstrap.cc:654] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:41.291600 8922 log.cc:824] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:41.297904 8923 tablet_bootstrap.cc:492] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: No bootstrap required, opened a new log
I20260805 23:03:41.298075 8922 tablet_bootstrap.cc:492] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: No bootstrap required, opened a new log
I20260805 23:03:41.298255 8923 ts_tablet_manager.cc:1397] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s
I20260805 23:03:41.298377 8922 ts_tablet_manager.cc:1397] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260805 23:03:41.299960 8921 raft_consensus.cc:348] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.300465 8921 raft_consensus.cc:374] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:41.300642 8921 raft_consensus.cc:729] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7b49c3bbe6a4482bf9dd417f5dac8bb, State: Initialized, Role: FOLLOWER
I20260805 23:03:41.301374 8921 consensus_queue.cc:260] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.303412 8921 ts_tablet_manager.cc:1428] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260805 23:03:41.309067 8922 raft_consensus.cc:348] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.309633 8922 raft_consensus.cc:374] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:41.309755 8922 raft_consensus.cc:729] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0716975df50a4c2296ce8af8b403fb8d, State: Initialized, Role: FOLLOWER
I20260805 23:03:41.309768 8923 raft_consensus.cc:348] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.310205 8923 raft_consensus.cc:374] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:41.310319 8923 raft_consensus.cc:729] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc84027369b4ae2a16d1e5be9b19d5c, State: Initialized, Role: FOLLOWER
I20260805 23:03:41.310506 8922 consensus_queue.cc:260] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.310958 8923 consensus_queue.cc:260] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.311745 8487 heartbeater.cc:503] Master 127.22.45.126:41803 was elected leader, sending a full tablet report...
I20260805 23:03:41.312109 8887 heartbeater.cc:503] Master 127.22.45.126:41803 was elected leader, sending a full tablet report...
I20260805 23:03:41.312604 8922 ts_tablet_manager.cc:1428] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
I20260805 23:03:41.312659 8923 ts_tablet_manager.cc:1428] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
W20260805 23:03:41.339406 8691 tablet.cc:2369] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:03:41.382952 8888 tablet.cc:2369] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:03:41.415298 8488 tablet.cc:2369] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:03:41.477010 8928 raft_consensus.cc:482] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:03:41.477339 8928 raft_consensus.cc:504] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.479741 8928 leader_election.cc:288] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc84027369b4ae2a16d1e5be9b19d5c (127.22.45.67:38349), 0716975df50a4c2296ce8af8b403fb8d (127.22.45.65:43827)
I20260805 23:03:41.487684 8916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.480318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:50133 (local address 127.22.45.67:38349)
0805 23:03:41.480542 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.480548 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.481085 (+ 537us) server_negotiation.cc:407] Connection header received
0805 23:03:41.481300 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.481305 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.481388 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.481493 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:41.482253 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.483481 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.485747 (+ 2266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.486622 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.486806 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.486885 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.487290 (+ 405us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.487436 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260805 23:03:41.487910 8917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.480270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:42847 (local address 127.22.45.65:43827)
0805 23:03:41.480509 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.480516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.481086 (+ 570us) server_negotiation.cc:407] Connection header received
0805 23:03:41.481307 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.481311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.481388 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.481493 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:41.482302 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.483433 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.485710 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.486627 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.486794 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.486881 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.487361 (+ 480us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.487504 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 23:03:41.488241 8933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.480035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:38349 (local address 127.22.45.66:50133)
0805 23:03:41.480946 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.480967 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:41.481157 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:41.481522 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:41.481526 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:41.481564 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:41.482087 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.482105 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.483605 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.483610 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.485480 (+ 1870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.485500 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.486888 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.486895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.487111 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.487144 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:03:41.487236 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 23:03:41.487398 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"mutex_wait_us":89,"spinlock_wait_cycles":20608,"thread_start_us":621,"threads_started":1}
I20260805 23:03:41.488574 8932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.480151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.22.45.66:42847)
0805 23:03:41.480946 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.480967 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:41.481157 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:41.481520 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:41.481526 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:41.481560 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:41.482152 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.482163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.483601 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.483607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.485506 (+ 1899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:41.485524 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.487031 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.487039 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:41.487195 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.487222 (+ 27us) client_negotiation.cc:769] Sending connection context
0805 23:03:41.487305 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 23:03:41.487451 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":76,"spinlock_wait_cycles":37760,"thread_start_us":407,"threads_started":1}
I20260805 23:03:41.489365 8813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a797ec7560df4520bdc1fa045db8e1d3" candidate_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" is_pre_election: true
I20260805 23:03:41.490046 8813 raft_consensus.cc:2454] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7b49c3bbe6a4482bf9dd417f5dac8bb in term 0.
I20260805 23:03:41.490835 8529 leader_election.cc:302] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc84027369b4ae2a16d1e5be9b19d5c, d7b49c3bbe6a4482bf9dd417f5dac8bb; no voters:
I20260805 23:03:41.490904 8429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a797ec7560df4520bdc1fa045db8e1d3" candidate_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0716975df50a4c2296ce8af8b403fb8d" is_pre_election: true
I20260805 23:03:41.491312 8928 raft_consensus.cc:2781] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:03:41.491468 8928 raft_consensus.cc:482] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:03:41.491561 8928 raft_consensus.cc:3037] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:41.491525 8429 raft_consensus.cc:2454] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7b49c3bbe6a4482bf9dd417f5dac8bb in term 0.
I20260805 23:03:41.494213 8928 raft_consensus.cc:504] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.494868 8928 leader_election.cc:288] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [CANDIDATE]: Term 1 election: Requested vote from peers 5dc84027369b4ae2a16d1e5be9b19d5c (127.22.45.67:38349), 0716975df50a4c2296ce8af8b403fb8d (127.22.45.65:43827)
I20260805 23:03:41.495467 8813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a797ec7560df4520bdc1fa045db8e1d3" candidate_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c"
I20260805 23:03:41.495484 8429 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a797ec7560df4520bdc1fa045db8e1d3" candidate_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0716975df50a4c2296ce8af8b403fb8d"
I20260805 23:03:41.495677 8813 raft_consensus.cc:3037] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:41.495682 8429 raft_consensus.cc:3037] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:41.497956 8813 raft_consensus.cc:2454] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7b49c3bbe6a4482bf9dd417f5dac8bb in term 1.
I20260805 23:03:41.497957 8429 raft_consensus.cc:2454] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7b49c3bbe6a4482bf9dd417f5dac8bb in term 1.
I20260805 23:03:41.498484 8531 leader_election.cc:302] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0716975df50a4c2296ce8af8b403fb8d, d7b49c3bbe6a4482bf9dd417f5dac8bb; no voters:
I20260805 23:03:41.498847 8928 raft_consensus.cc:2781] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:03:41.499334 8928 raft_consensus.cc:686] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 1 LEADER]: Becoming Leader. State: Replica: d7b49c3bbe6a4482bf9dd417f5dac8bb, State: Running, Role: LEADER
I20260805 23:03:41.499903 8928 consensus_queue.cc:237] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } }
I20260805 23:03:41.504494 8204 catalog_manager.cc:5495] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb reported cstate change: term changed from 0 to 1, leader changed from <none> to d7b49c3bbe6a4482bf9dd417f5dac8bb (127.22.45.66). New cstate: current_term: 1 leader_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7b49c3bbe6a4482bf9dd417f5dac8bb" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34281 } health_report { overall_health: HEALTHY } } }
I20260805 23:03:41.561655 8920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.555978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45620 (local address 127.22.45.66:34281)
0805 23:03:41.556196 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.556200 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.556219 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:03:41.556410 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.556416 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.556544 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.556736 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:03:41.557097 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.557836 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.559346 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.559791 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.559893 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.560431 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:03:41.561036 (+ 605us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:03:41.561150 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.561288 (+ 138us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.561376 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 23:03:41.571074 8813 raft_consensus.cc:1261] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 1 FOLLOWER]: Refusing update from remote peer d7b49c3bbe6a4482bf9dd417f5dac8bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:41.571075 8429 raft_consensus.cc:1261] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 1 FOLLOWER]: Refusing update from remote peer d7b49c3bbe6a4482bf9dd417f5dac8bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:41.572351 8928 consensus_queue.cc:1035] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "0716975df50a4c2296ce8af8b403fb8d" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43827 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:41.573176 8936 consensus_queue.cc:1035] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dc84027369b4ae2a16d1e5be9b19d5c" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:41.586109 8940 mvcc.cc:205] Tried to move back new op lower bound from 7315337304342441984 to 7315337304067756032. Current Snapshot: MvccSnapshot[applied={T|T < 7315337304342441984}]
I20260805 23:03:41.587945 8943 mvcc.cc:205] Tried to move back new op lower bound from 7315337304342441984 to 7315337304067756032. Current Snapshot: MvccSnapshot[applied={T|T < 7315337304342441984}]
I20260805 23:03:41.604156 8206 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:03:41.604492 8206 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:03:41.608529 8206 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ca10b30ce974961a8681f2a42410d63: Sending DeleteTablet for 3 replicas of tablet a797ec7560df4520bdc1fa045db8e1d3
I20260805 23:03:41.609929 8787 tablet_service.cc:1514] Processing DeleteTablet for tablet a797ec7560df4520bdc1fa045db8e1d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:41 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:39328
I20260805 23:03:41.610203 8398 tablet_service.cc:1514] Processing DeleteTablet for tablet a797ec7560df4520bdc1fa045db8e1d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:41 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:47840
I20260805 23:03:41.616492 8599 tablet_service.cc:1514] Processing DeleteTablet for tablet a797ec7560df4520bdc1fa045db8e1d3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:41 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:45610
I20260805 23:03:41.624105 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 8266
I20260805 23:03:41.635699 8959 tablet_replica.cc:330] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: stopping tablet replica
I20260805 23:03:41.636456 8959 raft_consensus.cc:2229] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:03:41.637151 8959 raft_consensus.cc:2258] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:41.639930 8959 ts_tablet_manager.cc:1905] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:41.646771 8917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.625272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47848 (local address 127.22.45.65:43827)
0805 23:03:41.625447 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.625454 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.625516 (+ 62us) server_negotiation.cc:407] Connection header received
0805 23:03:41.625763 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.625768 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.625854 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.625947 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:41.628522 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.629815 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.631748 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.632531 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.632658 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.637129 (+ 4471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:41.637151 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:41.637170 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:41.637228 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:41.641840 (+ 4612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.643068 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.643079 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.643083 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.643287 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.643915 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.643921 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.643924 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.644441 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:41.644804 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.646030 (+ 1226us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.646312 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 23:03:41.648779 8959 ts_tablet_manager.cc:1918] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:41.649047 8478 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:41.649088 8959 log.cc:1196] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/a797ec7560df4520bdc1fa045db8e1d3
I20260805 23:03:41.657814 8960 tablet_replica.cc:330] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: stopping tablet replica
I20260805 23:03:41.658572 8960 raft_consensus.cc:2229] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:03:41.662231 8960 raft_consensus.cc:2258] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:41.663650 8958 tablet_replica.cc:330] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: stopping tablet replica
I20260805 23:03:41.664223 8958 raft_consensus.cc:2229] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:03:41.667846 8960 ts_tablet_manager.cc:1905] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:41.668197 8958 raft_consensus.cc:2258] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:41.678468 8958 ts_tablet_manager.cc:1905] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:41.697718 8960 ts_tablet_manager.cc:1918] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:41.700914 8958 ts_tablet_manager.cc:1918] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:41.701323 8960 log.cc:1196] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/a797ec7560df4520bdc1fa045db8e1d3
I20260805 23:03:41.702075 8960 ts_tablet_manager.cc:1939] T a797ec7560df4520bdc1fa045db8e1d3 P d7b49c3bbe6a4482bf9dd417f5dac8bb: Deleting consensus metadata
I20260805 23:03:41.703109 8958 log.cc:1196] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/a797ec7560df4520bdc1fa045db8e1d3
I20260805 23:03:41.703806 8958 ts_tablet_manager.cc:1939] T a797ec7560df4520bdc1fa045db8e1d3 P 5dc84027369b4ae2a16d1e5be9b19d5c: Deleting consensus metadata
I20260805 23:03:41.705431 8186 catalog_manager.cc:4841] TS d7b49c3bbe6a4482bf9dd417f5dac8bb (127.22.45.66:34281): tablet a797ec7560df4520bdc1fa045db8e1d3 (table test-table [id=807157e0641648c8b25993598be122f7]) successfully deleted
I20260805 23:03:41.708279 8185 catalog_manager.cc:4841] TS 5dc84027369b4ae2a16d1e5be9b19d5c (127.22.45.67:38349): tablet a797ec7560df4520bdc1fa045db8e1d3 (table test-table [id=807157e0641648c8b25993598be122f7]) successfully deleted
I20260805 23:03:41.772536 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 8266
I20260805 23:03:41.772603 8959 ts_tablet_manager.cc:1939] T a797ec7560df4520bdc1fa045db8e1d3 P 0716975df50a4c2296ce8af8b403fb8d: Deleting consensus metadata
I20260805 23:03:41.795617 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 8491
W20260805 23:03:41.795642 8186 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.45.65:43827 (error 108)
I20260805 23:03:41.798292 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.797274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47856)
0805 23:03:41.797884 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.798046 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":351,"threads_started":1}
W20260805 23:03:41.798645 8186 catalog_manager.cc:4584] TS 0716975df50a4c2296ce8af8b403fb8d (127.22.45.65:43827): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a797ec7560df4520bdc1fa045db8e1d3: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
I20260805 23:03:41.816414 8920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.796924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45628 (local address 127.22.45.66:34281)
0805 23:03:41.797099 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.797104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.797120 (+ 16us) server_negotiation.cc:407] Connection header received
0805 23:03:41.797176 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.797187 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.797252 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.797372 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:41.799283 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.800150 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.801650 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.802145 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.802292 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.808676 (+ 6384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:41.808701 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:41.808720 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:41.808777 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:41.812474 (+ 3697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.813666 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.813676 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.813679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.813886 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.814379 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.814383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.814386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.814842 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:41.815248 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.815559 (+ 311us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.815851 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 23:03:41.817539 8682 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:41.852563 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.852014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47862)
0805 23:03:41.852283 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.852392 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260805 23:03:41.853781 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.853378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47874)
0805 23:03:41.853541 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.853628 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260805 23:03:41.914963 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.914242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47886)
0805 23:03:41.914651 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.914759 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240}
I20260805 23:03:41.916177 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.915729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47892)
0805 23:03:41.915927 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.916011 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260805 23:03:41.936260 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 8491
I20260805 23:03:41.957757 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 8695
I20260805 23:03:41.970939 8916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.958496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39336 (local address 127.22.45.67:38349)
0805 23:03:41.958687 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:41.958692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:41.958710 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:03:41.958812 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:41.958816 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:41.958880 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:41.959000 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:41.960283 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.961031 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.962344 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:41.962752 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:41.962849 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:41.965481 (+ 2632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:41.965497 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:41.965514 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:41.965566 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:41.968450 (+ 2884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.969155 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.969169 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.969172 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.969316 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:41.969619 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:41.969621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:41.969623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:41.969986 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:41.970223 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:41.970405 (+ 182us) server_negotiation.cc:299] Negotiation successful
0805 23:03:41.970572 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 23:03:41.971643 8879 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:41.996943 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.996400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47904)
0805 23:03:41.996667 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.996773 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260805 23:03:41.998065 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:41.997661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47914)
0805 23:03:41.997855 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:41.997930 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260805 23:03:42.062005 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 8695
I20260805 23:03:42.082373 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 8159
I20260805 23:03:42.083863 8251 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:42.200233 8966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:42.199487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43827 (local address 127.0.0.1:47922)
0805 23:03:42.199877 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:42.200030 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:43827: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223}
I20260805 23:03:42.200443 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 8159
I20260805 23:03:42.228122 22709 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260805 23:03:42.574259 22709 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260805 23:03:42.574556 22709 mini_ranger.cc:66] Stopping Ranger...
I20260805 23:03:42.921257 22709 mini_ranger.cc:68] Stopped Ranger
2026-08-05 23:03:42.921 UTC [6837] LOG: received smart shutdown request
2026-08-05 23:03:42.924 UTC [6837] LOG: background worker "logical replication launcher" (PID 6849) exited with exit code 1
2026-08-05 23:03:42.924 UTC [6842] LOG: shutting down
2026-08-05 23:03:43.064 UTC [6837] LOG: database system is shut down
2026-08-05T23:03:43Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (56461 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:03:43 dist-test-slave-1vmg krb5kdc[8982](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:03:43 dist-test-slave-1vmg krb5kdc[8982](info): set up 2 sockets
Aug 05 23:03:43 dist-test-slave-1vmg krb5kdc[8982](info): commencing operation
krb5kdc: starting...
W20260805 23:03:44.371209 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.147s user 0.000s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:03:44 dist-test-slave-1vmg krb5kdc[8982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:03:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:03:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:03:44.660535 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34217
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:34217,127.22.45.125:37161,127.22.45.124:32845
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:45.013988 8997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:45.014326 8997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:45.014467 8997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:45.022099 8997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:45.022243 8997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:45.022298 8997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:45.022384 8997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:45.022444 8997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:45.032902 8997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:34217,127.22.45.125:37161,127.22.45.124:32845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:45.034399 8997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:45.035838 8997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:45.048398 9005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:45.048504 9004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:45.048422 9007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:45.049461 8997 server_base.cc:1034] running on GCE node
I20260805 23:03:45.050433 8997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:45.052160 8997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:45.053421 8997 hybrid_clock.cc:648] HybridClock initialized: now 1785971025053367 us; error 44 us; skew 500 ppm
I20260805 23:03:45.053826 8997 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:45 dist-test-slave-1vmg krb5kdc[8982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:45.057317 8997 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:03:45.058941 8997 webserver.cc:460] Webserver started at http://127.22.45.126:44415/ using document root <none> and password file <none>
I20260805 23:03:45.059654 8997 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:45.059791 8997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:45.060092 8997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:45.063242 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235"
format_stamp: "Formatted at 2026-08-05 23:03:45 on dist-test-slave-1vmg"
server_key: "170e24e6596aed7dc37a37092162ac21"
server_key_iv: "ddef7fc8cd7963b9d87f48dcc3480a87"
server_key_version: "encryptionkey@0"
I20260805 23:03:45.064055 8997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235"
format_stamp: "Formatted at 2026-08-05 23:03:45 on dist-test-slave-1vmg"
server_key: "170e24e6596aed7dc37a37092162ac21"
server_key_iv: "ddef7fc8cd7963b9d87f48dcc3480a87"
server_key_version: "encryptionkey@0"
I20260805 23:03:45.069403 8997 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260805 23:03:45.072978 9016 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:45.074374 8997 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 23:03:45.074554 8997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235"
format_stamp: "Formatted at 2026-08-05 23:03:45 on dist-test-slave-1vmg"
server_key: "170e24e6596aed7dc37a37092162ac21"
server_key_iv: "ddef7fc8cd7963b9d87f48dcc3480a87"
server_key_version: "encryptionkey@0"
I20260805 23:03:45.074766 8997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:45.119462 8997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:45.123908 8997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:45.124233 8997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:45.144661 8997 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:34217
I20260805 23:03:45.144692 9092 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:34217 every 8 connection(s)
I20260805 23:03:45.146224 8997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:03:45.149538 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 8997
I20260805 23:03:45.149801 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:03:45.150635 22709 external_mini_cluster.cc:1428] Setting key 3d240ecc7340c757e9501d230b48860b
I20260805 23:03:45.150839 9093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:45.160943 9093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:03:45 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.125@KRBTEST.COM" created.
I20260805 23:03:45.189512 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.165161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34217 (local address 127.0.0.1:58448)
0805 23:03:45.166293 (+ 1132us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.166355 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:45.169104 (+ 2749us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:45.170287 (+ 1183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:45.170295 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:45.171260 (+ 965us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:45.171792 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.171822 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.173707 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.173713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.175531 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.175551 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.176755 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.176764 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.176954 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.177723 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:45.177761 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:45.181187 (+ 3426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:45.184900 (+ 3713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.184915 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.184929 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.185392 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.185850 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.185855 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.185859 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.186023 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.186887 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:45.186896 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:45.187153 (+ 257us) client_negotiation.cc:769] Sending connection context
0805 23:03:45.187399 (+ 246us) client_negotiation.cc:240] Negotiation successful
0805 23:03:45.188086 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"mutex_wait_us":158,"thread_start_us":480,"threads_started":1}
I20260805 23:03:45.189541 9097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.165161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58448 (local address 127.22.45.126:34217)
0805 23:03:45.167456 (+ 2295us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:45.167463 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:45.167516 (+ 53us) server_negotiation.cc:407] Connection header received
0805 23:03:45.169631 (+ 2115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:45.169639 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:45.169978 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:45.170172 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:45.172077 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.173481 (+ 1404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.175708 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.176429 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.176585 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.181489 (+ 4904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:45.181499 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:45.181513 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:45.181559 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:45.184735 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.185547 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.185554 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.185556 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.185731 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.186142 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.186146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.186148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.186740 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:45.186971 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:45.187568 (+ 597us) server_negotiation.cc:299] Negotiation successful
0805 23:03:45.187909 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2072,"spinlock_wait_cycles":72064,"thread_start_us":1767,"threads_started":1}
I20260805 23:03:45.193137 9093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:03:45.194592 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.194108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52796)
0805 23:03:45.194318 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.194448 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260805 23:03:45.194965 9018 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
I20260805 23:03:45.196734 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.196320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52812)
0805 23:03:45.196478 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.196557 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260805 23:03:45.196959 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:37161: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab.
Entry for principal kudu/127.22.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab.
I20260805 23:03:45.214421 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:37161
--webserver_interface=127.22.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab
--principal=kudu/127.22.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:34217,127.22.45.125:37161,127.22.45.124:32845
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:03:45.246461 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } attempt: 1
I20260805 23:03:45.247835 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.247334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52814)
0805 23:03:45.247535 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.247697 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260805 23:03:45.248868 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.248488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52820)
0805 23:03:45.248641 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.248723 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260805 23:03:45.249071 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:37161: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
I20260805 23:03:45.317348 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } attempt: 2
I20260805 23:03:45.318627 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.318096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52822)
0805 23:03:45.318352 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.318450 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260805 23:03:45.319753 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.319328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52832)
0805 23:03:45.319496 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.319577 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260805 23:03:45.319975 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:37161: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
I20260805 23:03:45.411266 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } attempt: 3
I20260805 23:03:45.412480 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.412005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52848)
0805 23:03:45.412229 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.412341 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260805 23:03:45.413647 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.413216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52852)
0805 23:03:45.413381 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.413469 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260805 23:03:45.413971 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:37161: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
I20260805 23:03:45.557273 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } attempt: 4
I20260805 23:03:45.558706 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.557978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52858)
0805 23:03:45.558388 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.558518 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224}
I20260805 23:03:45.559957 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.559491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52866)
0805 23:03:45.559648 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.559787 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260805 23:03:45.560242 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:37161: Network error: Client connection negotiation failed: client connection to 127.22.45.125:37161: connect: Connection refused (error 111)
W20260805 23:03:45.585026 9100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:45.585412 9100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:45.585551 9100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:45.594290 9100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:45.594450 9100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:45.594537 9100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:45.594619 9100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:45.594691 9100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:45.605754 9100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:34217,127.22.45.125:37161,127.22.45.124:32845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab
--principal=kudu/127.22.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:37161
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:45.607445 9100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:45.609038 9100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:45.622133 9109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:45.622284 9114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:45.622313 9110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:45.623358 9100 server_base.cc:1034] running on GCE node
I20260805 23:03:45.624276 9100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:45.625943 9100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:45.627170 9100 hybrid_clock.cc:648] HybridClock initialized: now 1785971025627121 us; error 44 us; skew 500 ppm
I20260805 23:03:45.627565 9100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:45 dist-test-slave-1vmg krb5kdc[8982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:45.631227 9100 init.cc:377] Logged in from keytab as kudu/127.22.45.125@KRBTEST.COM (short username kudu)
I20260805 23:03:45.633086 9100 webserver.cc:460] Webserver started at http://127.22.45.125:34533/ using document root <none> and password file <none>
I20260805 23:03:45.633896 9100 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:45.634032 9100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:45.634363 9100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:45.637840 9100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data/instance:
uuid: "414b42a8b7434393956f05cb2f948c03"
format_stamp: "Formatted at 2026-08-05 23:03:45 on dist-test-slave-1vmg"
server_key: "33e048358ec40a555a02b0464e6b418a"
server_key_iv: "488fcddb7306fbca2410b4b944b682b0"
server_key_version: "encryptionkey@0"
I20260805 23:03:45.638797 9100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/wal/instance:
uuid: "414b42a8b7434393956f05cb2f948c03"
format_stamp: "Formatted at 2026-08-05 23:03:45 on dist-test-slave-1vmg"
server_key: "33e048358ec40a555a02b0464e6b418a"
server_key_iv: "488fcddb7306fbca2410b4b944b682b0"
server_key_version: "encryptionkey@0"
I20260805 23:03:45.645165 9100 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260805 23:03:45.649562 9122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:45.651321 9100 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:03:45.651548 9100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/wal
uuid: "414b42a8b7434393956f05cb2f948c03"
format_stamp: "Formatted at 2026-08-05 23:03:45 on dist-test-slave-1vmg"
server_key: "33e048358ec40a555a02b0464e6b418a"
server_key_iv: "488fcddb7306fbca2410b4b944b682b0"
server_key_version: "encryptionkey@0"
I20260805 23:03:45.651782 9100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:45.672904 9100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:45.677497 9100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:45.677816 9100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:45.697307 9100 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.125:37161
I20260805 23:03:45.697332 9194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.125:37161 every 8 connection(s)
I20260805 23:03:45.698987 9100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
I20260805 23:03:45.703018 9195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:45.705533 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 9100
I20260805 23:03:45.705749 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-1/wal/instance
I20260805 23:03:45.706311 22709 external_mini_cluster.cc:1428] Setting key 19ca621fa4ee207f70289a6c64416ba0
I20260805 23:03:45.712303 9195 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:03:45 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.45.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.124@KRBTEST.COM" created.
I20260805 23:03:45.737401 9199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.716001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58454 (local address 127.22.45.126:34217)
0805 23:03:45.716628 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:45.716634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:45.717710 (+ 1076us) server_negotiation.cc:407] Connection header received
0805 23:03:45.720226 (+ 2516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:45.720231 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:45.720328 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:45.720433 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:45.722691 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.723584 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.725952 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.726389 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.726487 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.731008 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:45.731014 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:45.731018 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:45.731063 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:45.733773 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.734682 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.734686 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.734690 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.734832 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.735334 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.735339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.735341 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.735663 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:45.735829 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:45.736744 (+ 915us) server_negotiation.cc:299] Negotiation successful
0805 23:03:45.737001 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":334,"threads_started":1}
I20260805 23:03:45.738456 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.716555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34217 (local address 127.0.0.1:58454)
0805 23:03:45.717442 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.717509 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:45.719845 (+ 2336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:45.720728 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:45.720741 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:45.721616 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:45.722462 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.722489 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.723771 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.723776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.725787 (+ 2011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.725805 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.726638 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.726644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.726968 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.727799 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:45.727830 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:45.730656 (+ 2826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:45.733967 (+ 3311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.733978 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.733995 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.734542 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.734986 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.734991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.734996 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.735208 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.735804 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:45.735813 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:45.736310 (+ 497us) client_negotiation.cc:769] Sending connection context
0805 23:03:45.736611 (+ 301us) client_negotiation.cc:240] Negotiation successful
0805 23:03:45.737195 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":359,"threads_started":1}
I20260805 23:03:45.740314 9195 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:03:45 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:03:45.755100 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.741163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52882)
0805 23:03:45.741340 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.741359 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:45.741460 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:45.742611 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:45.742615 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:45.743119 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:45.743266 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.743275 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.744653 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.744657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.745484 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.745506 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.746364 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.746369 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.746554 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.747206 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:45.747225 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:45.749347 (+ 2122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:45.752577 (+ 3230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.752582 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.752587 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.752953 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.753311 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.753316 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.753320 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.753469 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.754085 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:45.754090 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:45.754232 (+ 142us) client_negotiation.cc:769] Sending connection context
0805 23:03:45.754350 (+ 118us) client_negotiation.cc:240] Negotiation successful
0805 23:03:45.754667 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260805 23:03:45.755199 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.741411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52882 (local address 127.22.45.125:37161)
0805 23:03:45.742157 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:45.742163 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:45.742191 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:03:45.742238 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:45.742244 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:45.742437 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:45.742589 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:45.743421 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.744510 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.745627 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.746200 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.746315 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.749573 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:45.749587 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:45.749603 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:45.749639 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:45.752442 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.753078 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.753086 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.753088 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.753209 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.753576 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.753581 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.753583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.753951 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:45.754168 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:45.754513 (+ 345us) server_negotiation.cc:299] Negotiation successful
0805 23:03:45.754784 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":589,"thread_start_us":436,"threads_started":1}
I20260805 23:03:45.758008 9195 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:03:45.759352 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.758731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53696)
0805 23:03:45.758969 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.759120 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260805 23:03:45.759629 9124 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
I20260805 23:03:45.761209 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.760856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53708)
0805 23:03:45.761004 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.761087 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260805 23:03:45.761418 9195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab.
Entry for principal kudu/127.22.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab.
I20260805 23:03:45.768211 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:32845
--webserver_interface=127.22.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab
--principal=kudu/127.22.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:34217,127.22.45.125:37161,127.22.45.124:32845
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:03:45.810783 9195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 1
I20260805 23:03:45.812155 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.811540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53714)
0805 23:03:45.811800 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.811939 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260805 23:03:45.813346 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.812889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53728)
0805 23:03:45.813080 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.813178 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260805 23:03:45.813607 9195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
I20260805 23:03:45.859503 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } attempt: 5
Aug 05 23:03:45 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:03:45.872895 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.860365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52892 (local address 127.22.45.125:37161)
0805 23:03:45.860558 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:45.860563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:45.860586 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:03:45.860774 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:45.860778 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:45.860845 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:45.860930 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:45.861786 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.862485 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.863662 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.864137 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.864253 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.867669 (+ 3416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:45.867674 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:45.867677 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:45.867712 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:45.870250 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.871092 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.871095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.871098 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.871231 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:45.871633 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:45.871636 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:45.871638 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:45.871908 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:45.872018 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:45.872478 (+ 460us) server_negotiation.cc:299] Negotiation successful
0805 23:03:45.872659 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:03:45.873099 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.860253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52892)
0805 23:03:45.860446 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.860469 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:45.860605 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:45.860998 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:45.861002 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:45.861417 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:45.861604 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.861613 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.862633 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.862638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.863513 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:45.863525 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:45.864292 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:45.864297 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:45.864468 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:45.865085 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:45.865104 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:45.867456 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:45.870404 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.870408 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.870413 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.870982 (+ 569us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.871342 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:45.871347 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:45.871351 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:45.871538 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:45.872020 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:45.872025 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:45.872229 (+ 204us) client_negotiation.cc:769] Sending connection context
0805 23:03:45.872384 (+ 155us) client_negotiation.cc:240] Negotiation successful
0805 23:03:45.872733 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260805 23:03:45.874318 9093 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:03:45.875447 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.875037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53732)
0805 23:03:45.875207 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.875294 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260805 23:03:45.876420 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.876073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53748)
0805 23:03:45.876226 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.876316 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 23:03:45.876616 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
I20260805 23:03:45.881865 9195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 2
I20260805 23:03:45.883203 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.882619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53756)
0805 23:03:45.882838 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.882984 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260805 23:03:45.884202 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.883881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53766)
0805 23:03:45.883999 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.884071 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260805 23:03:45.884413 9195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
I20260805 23:03:45.927855 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 1
I20260805 23:03:45.929039 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.928556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53768)
0805 23:03:45.928751 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.928874 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260805 23:03:45.930148 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.929795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53780)
0805 23:03:45.929916 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.929988 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260805 23:03:45.930359 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
I20260805 23:03:45.975637 9195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 3
I20260805 23:03:45.976918 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.976441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53790)
0805 23:03:45.976645 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.976749 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260805 23:03:45.978147 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.977653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53804)
0805 23:03:45.977900 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.977982 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260805 23:03:45.978359 9195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
I20260805 23:03:45.998567 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 2
I20260805 23:03:45.999959 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:45.999407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53808)
0805 23:03:45.999626 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:45.999749 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 23:03:46.001022 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.000698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53820)
0805 23:03:46.000827 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.000906 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260805 23:03:46.001255 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
I20260805 23:03:46.107466 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 3
I20260805 23:03:46.108706 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.108202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53824)
0805 23:03:46.108432 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.108534 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260805 23:03:46.109735 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.109367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53840)
0805 23:03:46.109559 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.109629 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260805 23:03:46.109946 9093 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
W20260805 23:03:46.118827 9208 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:46.119195 9208 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:46.119334 9208 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260805 23:03:46.121573 9195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 4
I20260805 23:03:46.122807 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.122317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53856)
0805 23:03:46.122544 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.122639 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 23:03:46.123839 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.123452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53868)
0805 23:03:46.123607 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.123700 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260805 23:03:46.124167 9195 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:32845: Network error: Client connection negotiation failed: client connection to 127.22.45.124:32845: connect: Connection refused (error 111)
W20260805 23:03:46.127467 9208 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:46.127573 9208 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:46.127647 9208 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:46.127731 9208 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:46.127785 9208 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:46.138075 9208 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:34217,127.22.45.125:37161,127.22.45.124:32845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab
--principal=kudu/127.22.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:32845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:46.139616 9208 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:46.141065 9208 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:46.163094 9216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:46.163087 9214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:46.163784 9208 server_base.cc:1034] running on GCE node
W20260805 23:03:46.164156 9220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:46.165051 9208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:46.166548 9208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:46.167760 9208 hybrid_clock.cc:648] HybridClock initialized: now 1785971026167673 us; error 89 us; skew 500 ppm
I20260805 23:03:46.168112 9208 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971026, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:46.171324 9208 init.cc:377] Logged in from keytab as kudu/127.22.45.124@KRBTEST.COM (short username kudu)
I20260805 23:03:46.173074 9208 webserver.cc:460] Webserver started at http://127.22.45.124:37033/ using document root <none> and password file <none>
I20260805 23:03:46.173848 9208 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:46.173961 9208 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:46.174269 9208 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:46.177410 9208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data/instance:
uuid: "4cda5f6644734a9492804824e248f1c3"
format_stamp: "Formatted at 2026-08-05 23:03:46 on dist-test-slave-1vmg"
server_key: "3ea13995ecde4068bf747e701c5b87dc"
server_key_iv: "983685092bf40a3da5449252c734af69"
server_key_version: "encryptionkey@0"
I20260805 23:03:46.178658 9208 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/wal/instance:
uuid: "4cda5f6644734a9492804824e248f1c3"
format_stamp: "Formatted at 2026-08-05 23:03:46 on dist-test-slave-1vmg"
server_key: "3ea13995ecde4068bf747e701c5b87dc"
server_key_iv: "983685092bf40a3da5449252c734af69"
server_key_version: "encryptionkey@0"
I20260805 23:03:46.184818 9208 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260805 23:03:46.188813 9230 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:46.190528 9208 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 23:03:46.190748 9208 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/wal
uuid: "4cda5f6644734a9492804824e248f1c3"
format_stamp: "Formatted at 2026-08-05 23:03:46 on dist-test-slave-1vmg"
server_key: "3ea13995ecde4068bf747e701c5b87dc"
server_key_iv: "983685092bf40a3da5449252c734af69"
server_key_version: "encryptionkey@0"
I20260805 23:03:46.190999 9208 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:46.207216 9208 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:46.211931 9208 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:46.212220 9208 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:46.231817 9208 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.124:32845
I20260805 23:03:46.231840 9290 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.124:32845 every 8 connection(s)
I20260805 23:03:46.233317 9208 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
I20260805 23:03:46.235165 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 9208
I20260805 23:03:46.235392 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACert.1785970804553337-22709-0/minicluster-data/master-2/wal/instance
I20260805 23:03:46.236038 22709 external_mini_cluster.cc:1428] Setting key 148b13bfc6f46a42955e545a3671adf6
I20260805 23:03:46.237833 9293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:46.247174 9293 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971026, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:46.266145 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.238149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53882 (local address 127.22.45.124:32845)
0805 23:03:46.239087 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.239104 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.239162 (+ 58us) server_negotiation.cc:407] Connection header received
0805 23:03:46.241253 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.241284 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.241904 (+ 620us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.242397 (+ 493us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.245191 (+ 2794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.247417 (+ 2226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.249548 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.250789 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.251040 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.257019 (+ 5979us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.257036 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.257056 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.257112 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.260714 (+ 3602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.261577 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.261587 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.261598 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.261842 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.262303 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.262308 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.262310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.263184 (+ 874us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.263475 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.264371 (+ 896us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.264898 (+ 527us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":407,"threads_started":1}
I20260805 23:03:46.269327 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.250446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.22.45.126:34217)
0805 23:03:46.251056 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.251062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.251784 (+ 722us) server_negotiation.cc:407] Connection header received
0805 23:03:46.251849 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.251853 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.251937 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.252391 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.253397 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.254105 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.255776 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.256477 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.256767 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.261496 (+ 4729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.261505 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.261511 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.261563 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.265128 (+ 3565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.266125 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.266132 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.266135 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.266311 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.267441 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.267446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.267449 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.267854 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.268029 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.268549 (+ 520us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.268842 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":258,"threads_started":1}
I20260805 23:03:46.269500 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.250428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34217 (local address 127.0.0.1:58458)
0805 23:03:46.251444 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.251502 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:46.251668 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:46.252134 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:46.252142 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:46.252930 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:46.253231 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.253242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.254280 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.254284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.255597 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.255616 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.256875 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.256885 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.257139 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.257922 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:46.257968 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:46.261220 (+ 3252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:46.265283 (+ 4063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.265297 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.265305 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.265959 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.267096 (+ 1137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.267101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.267105 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.267308 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.267996 (+ 688us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:46.268003 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:46.268201 (+ 198us) client_negotiation.cc:769] Sending connection context
0805 23:03:46.268403 (+ 202us) client_negotiation.cc:240] Negotiation successful
0805 23:03:46.269117 (+ 714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":735,"thread_start_us":572,"threads_started":1}
I20260805 23:03:46.271615 9293 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971026, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:46.287146 9093 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 4
I20260805 23:03:46.287648 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.272554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52896 (local address 127.22.45.125:37161)
0805 23:03:46.272735 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.272740 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.272968 (+ 228us) server_negotiation.cc:407] Connection header received
0805 23:03:46.273036 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.273042 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.273157 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.273257 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.274069 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.274728 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.276041 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.276733 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.277227 (+ 494us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.281034 (+ 3807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.281040 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.281043 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.281082 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.284392 (+ 3310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.285388 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.285394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.285398 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.285576 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.286073 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.286078 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.286081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.286394 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.286539 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.286973 (+ 434us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.287199 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:03:46.287909 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.272472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:37161 (local address 127.0.0.1:52896)
0805 23:03:46.272731 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.272751 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:46.272860 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:46.273301 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:46.273306 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:46.273748 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:46.273929 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.273940 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.274862 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.274868 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.275884 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.275898 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.277248 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.277255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.277479 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.278051 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:46.278074 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:46.280760 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:46.284610 (+ 3850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.284617 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.284621 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.285213 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.285736 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.285741 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.285746 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.285931 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.286512 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:46.286517 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:46.286680 (+ 163us) client_negotiation.cc:769] Sending connection context
0805 23:03:46.286817 (+ 137us) client_negotiation.cc:240] Negotiation successful
0805 23:03:46.287585 (+ 768us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139}
I20260805 23:03:46.289475 9293 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:03:46.291801 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.269854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58470 (local address 127.22.45.126:34217)
0805 23:03:46.270058 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.270063 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.270773 (+ 710us) server_negotiation.cc:407] Connection header received
0805 23:03:46.270985 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.270991 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.271068 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.271148 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.272831 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.273769 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.275720 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.276258 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.276367 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.282531 (+ 6164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.282540 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.282545 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.282593 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.286073 (+ 3480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.287118 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.287130 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.287133 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.287312 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.289190 (+ 1878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.289196 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.289199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.289632 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.289982 (+ 350us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.291133 (+ 1151us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.291393 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":261,"threads_started":1}
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971026, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:03:46.308331 9096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.287798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53898)
0805 23:03:46.288203 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.288225 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:46.288334 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:46.289320 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:46.289326 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:46.289830 (+ 504us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:46.290054 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.290068 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.291641 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.291647 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.293180 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.293195 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.295017 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.295024 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.295198 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.295888 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:46.295912 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:46.299288 (+ 3376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:46.304876 (+ 5588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.304883 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.304888 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.305525 (+ 637us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.306153 (+ 628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.306159 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.306162 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.306376 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.307176 (+ 800us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:46.307182 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:46.307394 (+ 212us) client_negotiation.cc:769] Sending connection context
0805 23:03:46.307540 (+ 146us) client_negotiation.cc:240] Negotiation successful
0805 23:03:46.307895 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275}
I20260805 23:03:46.308893 9301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.290173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53908)
0805 23:03:46.292433 (+ 2260us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.292455 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:46.292578 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:46.293423 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:46.293428 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:46.293930 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:46.294119 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.294129 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.295879 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.295884 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.297185 (+ 1301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.297212 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.298119 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.298125 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.298320 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.299039 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:46.299062 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:46.301924 (+ 2862us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:46.306094 (+ 4170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.306099 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.306102 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.306620 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.307109 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.307114 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.307117 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.307278 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.307852 (+ 574us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:46.307856 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:46.308003 (+ 147us) client_negotiation.cc:769] Sending connection context
0805 23:03:46.308162 (+ 159us) client_negotiation.cc:240] Negotiation successful
0805 23:03:46.308521 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2137}
I20260805 23:03:46.309612 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.288707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53898 (local address 127.22.45.124:32845)
0805 23:03:46.288896 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.288901 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.288919 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:03:46.288963 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.288968 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.289040 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.289121 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.290281 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.291463 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.293988 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.294665 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.294802 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.299572 (+ 4770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.299580 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.299585 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.299631 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.304620 (+ 4989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.305753 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.305759 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.305764 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.305982 (+ 218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.306528 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.306538 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.306542 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.307009 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.308802 (+ 1793us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.308960 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.309269 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:03:46.310075 9303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.290449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53908 (local address 127.22.45.124:32845)
0805 23:03:46.293128 (+ 2679us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.293133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.293156 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:03:46.293202 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.293207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.293277 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.293383 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.294294 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.295748 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.297375 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.297973 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.298623 (+ 650us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.302207 (+ 3584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.302215 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.302220 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.302261 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.305936 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.306780 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.306784 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.306788 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.306998 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.307411 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.307416 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.307419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.307729 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.309308 (+ 1579us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.309448 (+ 140us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.309669 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2555,"thread_start_us":2376,"threads_started":1}
I20260805 23:03:46.316710 9293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3: Bootstrap starting.
I20260805 23:03:46.316705 9093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: Bootstrap starting.
I20260805 23:03:46.319270 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.295878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.22.45.125:37161)
0805 23:03:46.297530 (+ 1652us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.297536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.297555 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:03:46.297612 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.297617 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.297707 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.299799 (+ 2092us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.299975 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.301075 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.303057 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.303709 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.304453 (+ 744us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.310685 (+ 6232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.310692 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.310696 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.310731 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.314636 (+ 3905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.315835 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.315842 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.315845 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.316045 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.316576 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.316581 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.316584 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.316995 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.317311 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.318574 (+ 1263us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.318865 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1507}
I20260805 23:03:46.321573 9093 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:46.323192 9293 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:46.323163 9093 log.cc:824] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:46.325528 9293 log.cc:824] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:46.325683 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:03:46.329502 9293 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3: No bootstrap required, opened a new log
I20260805 23:03:46.333451 9093 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: No bootstrap required, opened a new log
I20260805 23:03:46.340801 9293 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.341361 9293 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:46.341485 9293 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cda5f6644734a9492804824e248f1c3, State: Initialized, Role: FOLLOWER
I20260805 23:03:46.343106 9293 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.365661 9299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.342094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58478 (local address 127.22.45.126:34217)
0805 23:03:46.342362 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.342369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.342825 (+ 456us) server_negotiation.cc:407] Connection header received
0805 23:03:46.343108 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.343113 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.343205 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.343283 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.345927 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.347298 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.350091 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.350889 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.351059 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.355635 (+ 4576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.355644 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.355648 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.355701 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.359941 (+ 4240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.360923 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.360929 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.360933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.361147 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.361985 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.361991 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.361994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.362433 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.362690 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.363606 (+ 916us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.363878 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260805 23:03:46.365630 9314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.366133 9314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:03:46.367290 9293 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:46.369094 9093 raft_consensus.cc:348] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.369645 9093 raft_consensus.cc:374] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:46.369781 9093 raft_consensus.cc:729] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aacf02f0b19f46c68f7e1b1ecc1a6235, State: Initialized, Role: FOLLOWER
I20260805 23:03:46.370631 9093 consensus_queue.cc:260] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.371744 9202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.342133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52910 (local address 127.22.45.125:37161)
0805 23:03:46.342512 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.342518 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.342544 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:03:46.342832 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.342838 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.342967 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.343040 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.345932 (+ 2892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.347299 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.350151 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.350942 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.351059 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.359602 (+ 8543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.359612 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.359617 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.359679 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.364867 (+ 5188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.367865 (+ 2998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.367874 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.367877 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.368110 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.368730 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.368737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.368741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.369201 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.369462 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.371074 (+ 1612us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.371360 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260}
I20260805 23:03:46.374909 9320 sys_catalog.cc:455] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.375420 9320 sys_catalog.cc:458] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:03:46.377089 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.343214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53922 (local address 127.22.45.124:32845)
0805 23:03:46.343452 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.343458 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.353775 (+ 10317us) server_negotiation.cc:407] Connection header received
0805 23:03:46.354364 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.354372 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.354473 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.354555 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.356681 (+ 2126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.357872 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.363070 (+ 5198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.363823 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.363931 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.369639 (+ 5708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.369647 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.369651 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.369703 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.373729 (+ 4026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.374718 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.374723 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.374726 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.374880 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.375355 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.375361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.375364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.375801 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.376066 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.376444 (+ 378us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.376728 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260805 23:03:46.377274 9023 tablet.cc:2369] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:03:46.378706 9093 sys_catalog.cc:564] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [sys.catalog]: configured and running, proceeding with master startup.
W20260805 23:03:46.398097 9350 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:03:46.398275 9350 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260805 23:03:46.402971 9353 catalog_manager.cc:1558] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:03:46.403132 9353 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 23:03:46.395208 8997 master_runner.cc:186] Error getting master registration for 127.22.45.125:37161: OK, instance_id { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" instance_seqno: 1785971025691671 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 23:03:46.408434 8997 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 23:03:46.401970 9208 master_runner.cc:186] Error getting master registration for 127.22.45.125:37161: OK, instance_id { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" instance_seqno: 1785971025691671 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 23:03:46.415349 9208 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 23:03:46.423408 9195 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } attempt: 5
Aug 05 23:03:46 dist-test-slave-1vmg krb5kdc[8982](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971025, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
I20260805 23:03:46.438864 9200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.424175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:32845 (local address 127.0.0.1:53930)
0805 23:03:46.424372 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:46.424395 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:46.424528 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:46.424999 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:46.425013 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:46.425596 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:46.425830 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.425843 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.427380 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.427387 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.428728 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:46.428745 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.429871 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.429878 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:46.430053 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.430724 (+ 671us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:46.430743 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:46.432936 (+ 2193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:46.436189 (+ 3253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.436194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.436199 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.436632 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.437069 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:46.437074 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:46.437078 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:46.437226 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:46.437787 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:46.437792 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:46.437975 (+ 183us) client_negotiation.cc:769] Sending connection context
0805 23:03:46.438143 (+ 168us) client_negotiation.cc:240] Negotiation successful
0805 23:03:46.438474 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260805 23:03:46.439913 9298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:46.424498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53930 (local address 127.22.45.124:32845)
0805 23:03:46.424715 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:46.424720 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:46.424735 (+ 15us) server_negotiation.cc:407] Connection header received
0805 23:03:46.424788 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:46.424792 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:46.424850 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:46.424931 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:46.426036 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.427206 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.428943 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:46.429623 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:46.429738 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:46.433148 (+ 3410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:46.433153 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:46.433156 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:46.433192 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:46.436033 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.436758 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.436763 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.436765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.436949 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:46.437334 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:46.437339 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:46.437343 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:46.437667 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:46.437812 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:46.439285 (+ 1473us) server_negotiation.cc:299] Negotiation successful
0805 23:03:46.439535 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 23:03:46.445772 9195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03: Bootstrap starting.
I20260805 23:03:46.448745 9314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:03:46.449081 9314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.449522 9195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:46.450826 9314 leader_election.cc:288] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aacf02f0b19f46c68f7e1b1ecc1a6235 (127.22.45.126:34217), 414b42a8b7434393956f05cb2f948c03 (127.22.45.125:37161)
I20260805 23:03:46.450888 9195 log.cc:824] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:46.453493 9059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cda5f6644734a9492804824e248f1c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" is_pre_election: true
I20260805 23:03:46.454273 9059 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cda5f6644734a9492804824e248f1c3 in term 0.
I20260805 23:03:46.455600 9231 leader_election.cc:302] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cda5f6644734a9492804824e248f1c3, aacf02f0b19f46c68f7e1b1ecc1a6235; no voters:
I20260805 23:03:46.456668 9314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:03:46.456854 9314 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:03:46.456972 9314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:46.461081 9314 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.464262 9059 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cda5f6644734a9492804824e248f1c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235"
I20260805 23:03:46.464596 9059 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [term 0 FOLLOWER]: Advancing to term 1
W20260805 23:03:46.469115 9236 tablet.cc:2369] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:03:46.470089 9314 leader_election.cc:288] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [CANDIDATE]: Term 1 election: Requested vote from peers aacf02f0b19f46c68f7e1b1ecc1a6235 (127.22.45.126:34217), 414b42a8b7434393956f05cb2f948c03 (127.22.45.125:37161)
I20260805 23:03:46.475566 9059 raft_consensus.cc:2454] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cda5f6644734a9492804824e248f1c3 in term 1.
I20260805 23:03:46.479568 9231 leader_election.cc:302] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4cda5f6644734a9492804824e248f1c3, aacf02f0b19f46c68f7e1b1ecc1a6235; no voters:
I20260805 23:03:46.480455 9314 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:03:46.493376 9314 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [term 1 LEADER]: Becoming Leader. State: Replica: 4cda5f6644734a9492804824e248f1c3, State: Running, Role: LEADER
I20260805 23:03:46.493572 9195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03: No bootstrap required, opened a new log
I20260805 23:03:46.494235 9314 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.509449 9358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cda5f6644734a9492804824e248f1c3. Latest consensus state: current_term: 1 leader_uuid: "4cda5f6644734a9492804824e248f1c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.509963 9358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:46.516851 9195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.517863 9195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:46.518143 9195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 414b42a8b7434393956f05cb2f948c03, State: Initialized, Role: FOLLOWER
I20260805 23:03:46.519776 9195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } }
I20260805 23:03:46.520242 9360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:03:46.530179 9360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:03:46.532917 9160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cda5f6644734a9492804824e248f1c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414b42a8b7434393956f05cb2f948c03" is_pre_election: true
I20260805 23:03:46.533675 9160 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4cda5f6644734a9492804824e248f1c3 in term 0.
I20260805 23:03:46.534121 9159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4cda5f6644734a9492804824e248f1c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "414b42a8b7434393956f05cb2f948c03"
I20260805 23:03:46.534409 9159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:46.538285 9159 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4cda5f6644734a9492804824e248f1c3 in term 1.
I20260805 23:03:46.539986 9195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:46.540634 9361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.542423 9361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:03:46.552978 9159 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [term 1 FOLLOWER]: Refusing update from remote peer 4cda5f6644734a9492804824e248f1c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:46.554313 9358 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:46.561044 9059 raft_consensus.cc:1261] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [term 1 FOLLOWER]: Refusing update from remote peer 4cda5f6644734a9492804824e248f1c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:46.566722 9358 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:46.580325 9320 sys_catalog.cc:455] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cda5f6644734a9492804824e248f1c3. Latest consensus state: current_term: 1 leader_uuid: "4cda5f6644734a9492804824e248f1c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.580761 9320 sys_catalog.cc:458] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:03:46.601492 9371 mvcc.cc:205] Tried to move back new op lower bound from 7315337324747624448 to 7315337324527935488. Current Snapshot: MvccSnapshot[applied={T|T < 7315337324747624448 or (T in {7315337324747624448})}]
I20260805 23:03:46.602581 9320 sys_catalog.cc:455] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4cda5f6644734a9492804824e248f1c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.602896 9320 sys_catalog.cc:458] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:03:46.605283 9358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4cda5f6644734a9492804824e248f1c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.605612 9358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:46.606539 9360 catalog_manager.cc:1347] Generated new cluster ID: d6aa120398b34224a0782aae499e1e57
I20260805 23:03:46.606652 9360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:03:46.606796 9362 mvcc.cc:205] Tried to move back new op lower bound from 7315337324747624448 to 7315337324527935488. Current Snapshot: MvccSnapshot[applied={T|T < 7315337324747624448 or (T in {7315337324747624448})}]
I20260805 23:03:46.608327 9314 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4cda5f6644734a9492804824e248f1c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.608377 9361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4cda5f6644734a9492804824e248f1c3. Latest consensus state: current_term: 1 leader_uuid: "4cda5f6644734a9492804824e248f1c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.608668 9361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:03:46.608693 9314 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:46.610488 9372 mvcc.cc:205] Tried to move back new op lower bound from 7315337324747624448 to 7315337324527935488. Current Snapshot: MvccSnapshot[applied={T|T < 7315337324747624448}]
I20260805 23:03:46.611781 9361 sys_catalog.cc:455] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4cda5f6644734a9492804824e248f1c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aacf02f0b19f46c68f7e1b1ecc1a6235" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34217 } } peers { permanent_uuid: "414b42a8b7434393956f05cb2f948c03" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 37161 } } peers { permanent_uuid: "4cda5f6644734a9492804824e248f1c3" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 32845 } } }
I20260805 23:03:46.612026 9361 sys_catalog.cc:458] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:03:46.640897 9360 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:03:46.643098 9360 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:03:46.658495 9387 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 23:03:46.670723 9360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4cda5f6644734a9492804824e248f1c3: Generated new TSK 0
I20260805 23:03:46.671963 9360 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:03:47.405273 9353 catalog_manager.cc:1259] Loaded cluster ID: d6aa120398b34224a0782aae499e1e57
I20260805 23:03:47.405396 9353 catalog_manager.cc:1552] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: loading cluster ID for follower catalog manager: success
I20260805 23:03:47.408070 9353 catalog_manager.cc:1574] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: acquiring CA information for follower catalog manager: success
I20260805 23:03:47.410138 9353 catalog_manager.cc:1602] T 00000000000000000000000000000000 P aacf02f0b19f46c68f7e1b1ecc1a6235: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 23:03:47.663322 9387 catalog_manager.cc:1259] Loaded cluster ID: d6aa120398b34224a0782aae499e1e57
I20260805 23:03:47.663455 9387 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03: loading cluster ID for follower catalog manager: success
I20260805 23:03:47.666752 9387 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03: acquiring CA information for follower catalog manager: success
I20260805 23:03:47.669127 9387 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 414b42a8b7434393956f05cb2f948c03: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 23:03:47.802186 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 8997
I20260805 23:03:47.803619 9087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:47.915311 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 8997
I20260805 23:03:47.953217 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 9100
I20260805 23:03:47.954510 9187 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:48.075132 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 9100
I20260805 23:03:48.098778 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 9208
I20260805 23:03:48.099959 9284 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:48.212365 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:48.211544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34217 (local address 127.0.0.1:58492)
0805 23:03:48.212026 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:48.212190 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:34217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":266,"threads_started":1}
I20260805 23:03:48.212357 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 9208
2026-08-05T23:03:48Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5041 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:03:48 dist-test-slave-1vmg krb5kdc[9406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:03:48 dist-test-slave-1vmg krb5kdc[9406](info): set up 2 sockets
Aug 05 23:03:48 dist-test-slave-1vmg krb5kdc[9406](info): commencing operation
krb5kdc: starting...
W20260805 23:03:49.444595 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.004s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:03:49 dist-test-slave-1vmg krb5kdc[9406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:03:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:03:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:03:49.746282 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:33655
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:33655
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:50.106455 9424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:50.106822 9424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:50.106964 9424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:50.114780 9424 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:50.114974 9424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:50.115065 9424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:50.115146 9424 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:50.115221 9424 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:50.126219 9424 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:33655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:33655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:50.127750 9424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:50.129156 9424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:50.141708 9432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:50.141826 9430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:50.142369 9429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:50.143198 9424 server_base.cc:1034] running on GCE node
I20260805 23:03:50.144093 9424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:50.145898 9424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:50.147346 9424 hybrid_clock.cc:648] HybridClock initialized: now 1785971030147275 us; error 74 us; skew 500 ppm
I20260805 23:03:50.147791 9424 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:50 dist-test-slave-1vmg krb5kdc[9406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971030, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:50.151767 9424 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:03:50.153710 9424 webserver.cc:460] Webserver started at http://127.22.45.126:45931/ using document root <none> and password file <none>
I20260805 23:03:50.154565 9424 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:50.154719 9424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:50.155141 9424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:50.158674 9424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "337dcd24807a425299b71ae2f54c3b8c"
format_stamp: "Formatted at 2026-08-05 23:03:50 on dist-test-slave-1vmg"
server_key: "f0b34a7bcdfde867ab71304696786f40"
server_key_iv: "a58ce4be7a265647cd303c6cb375bfe9"
server_key_version: "encryptionkey@0"
I20260805 23:03:50.159654 9424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "337dcd24807a425299b71ae2f54c3b8c"
format_stamp: "Formatted at 2026-08-05 23:03:50 on dist-test-slave-1vmg"
server_key: "f0b34a7bcdfde867ab71304696786f40"
server_key_iv: "a58ce4be7a265647cd303c6cb375bfe9"
server_key_version: "encryptionkey@0"
I20260805 23:03:50.165998 9424 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:03:50.170475 9442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:50.172537 9424 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:03:50.172806 9424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "337dcd24807a425299b71ae2f54c3b8c"
format_stamp: "Formatted at 2026-08-05 23:03:50 on dist-test-slave-1vmg"
server_key: "f0b34a7bcdfde867ab71304696786f40"
server_key_iv: "a58ce4be7a265647cd303c6cb375bfe9"
server_key_version: "encryptionkey@0"
I20260805 23:03:50.173055 9424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:50.200531 9424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:50.205469 9424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:50.205787 9424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:50.225171 9424 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:33655
I20260805 23:03:50.225215 9515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:33655 every 8 connection(s)
I20260805 23:03:50.226577 9424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:03:50.227339 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 9424
I20260805 23:03:50.227586 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:03:50.228413 22709 external_mini_cluster.cc:1428] Setting key da996051e7d7c24d815b1a6cbc52456a
I20260805 23:03:50.231076 9516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:03:50 dist-test-slave-1vmg krb5kdc[9406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:50.243754 9516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c: Bootstrap starting.
I20260805 23:03:50.247709 9516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:50.248998 9516 log.cc:824] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:50.252967 9516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c: No bootstrap required, opened a new log
I20260805 23:03:50.254092 9520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:50.230337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60126 (local address 127.22.45.126:33655)
0805 23:03:50.231241 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:50.231254 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:50.231300 (+ 46us) server_negotiation.cc:407] Connection header received
0805 23:03:50.233005 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:50.233028 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:50.233450 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:50.233899 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:50.235678 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:50.237121 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:50.238565 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:50.239437 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:50.239639 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:50.244701 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:50.244714 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:50.244732 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:50.244789 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:50.249075 (+ 4286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:50.250215 (+ 1140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:50.250230 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:50.250240 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:50.250508 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:50.251037 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:50.251041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:50.251043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:50.251644 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:50.251886 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:50.252449 (+ 563us) server_negotiation.cc:299] Negotiation successful
0805 23:03:50.252835 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":640,"thread_start_us":362,"threads_started":1}
I20260805 23:03:50.259048 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:03:50.263357 9516 raft_consensus.cc:348] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "337dcd24807a425299b71ae2f54c3b8c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33655 } }
I20260805 23:03:50.263789 9516 raft_consensus.cc:374] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:50.263878 9516 raft_consensus.cc:729] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 337dcd24807a425299b71ae2f54c3b8c, State: Initialized, Role: FOLLOWER
I20260805 23:03:50.264451 9516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "337dcd24807a425299b71ae2f54c3b8c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33655 } }
I20260805 23:03:50.264670 9516 raft_consensus.cc:388] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:03:50.264775 9516 raft_consensus.cc:482] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:03:50.264912 9516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:50.267159 9516 raft_consensus.cc:504] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "337dcd24807a425299b71ae2f54c3b8c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33655 } }
I20260805 23:03:50.267674 9516 leader_election.cc:302] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 337dcd24807a425299b71ae2f54c3b8c; no voters:
I20260805 23:03:50.268258 9516 leader_election.cc:288] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:03:50.268404 9522 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:03:50.269060 9522 raft_consensus.cc:686] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [term 1 LEADER]: Becoming Leader. State: Replica: 337dcd24807a425299b71ae2f54c3b8c, State: Running, Role: LEADER
I20260805 23:03:50.269627 9522 consensus_queue.cc:237] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "337dcd24807a425299b71ae2f54c3b8c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33655 } }
I20260805 23:03:50.270392 9516 sys_catalog.cc:564] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:50.272560 9525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 337dcd24807a425299b71ae2f54c3b8c. Latest consensus state: current_term: 1 leader_uuid: "337dcd24807a425299b71ae2f54c3b8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "337dcd24807a425299b71ae2f54c3b8c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33655 } } }
I20260805 23:03:50.272586 9524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "337dcd24807a425299b71ae2f54c3b8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "337dcd24807a425299b71ae2f54c3b8c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 33655 } } }
I20260805 23:03:50.273068 9525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:50.273068 9524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:50.279585 9530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:03:50.285547 9530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:03:50.296429 9530 catalog_manager.cc:1347] Generated new cluster ID: ca71fbc659a94aeeaf902fff35d9abb2
I20260805 23:03:50.296586 9530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:03:50.311400 9530 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:03:50.313277 9530 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:03:50.322789 9530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 337dcd24807a425299b71ae2f54c3b8c: Generated new TSK 0
I20260805 23:03:50.323922 9530 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:03:50.374454 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 9424
I20260805 23:03:50.375908 9508 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:50.474078 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 9424
2026-08-05T23:03:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2253 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:03:50 dist-test-slave-1vmg krb5kdc[9561](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:03:50 dist-test-slave-1vmg krb5kdc[9561](info): set up 2 sockets
Aug 05 23:03:50 dist-test-slave-1vmg krb5kdc[9561](info): commencing operation
krb5kdc: starting...
W20260805 23:03:51.672776 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.154s user 0.004s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:03:51 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:03:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:03:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:03:51.976310 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39037
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:52.344348 9576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:52.344691 9576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:52.344833 9576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:52.352432 9576 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:52.352589 9576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:52.352639 9576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:52.352730 9576 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:52.352795 9576 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:52.363467 9576 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:52.365005 9576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:52.366451 9576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:52.379150 9582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:52.379227 9583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:52.379171 9586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:52.380095 9576 server_base.cc:1034] running on GCE node
I20260805 23:03:52.380900 9576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:52.382351 9576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:52.383567 9576 hybrid_clock.cc:648] HybridClock initialized: now 1785971032383505 us; error 49 us; skew 500 ppm
I20260805 23:03:52.383908 9576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:52 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971032, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:52.387285 9576 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:03:52.388835 9576 webserver.cc:460] Webserver started at http://127.22.45.126:41273/ using document root <none> and password file <none>
I20260805 23:03:52.389542 9576 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:52.389654 9576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:52.389927 9576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:52.393209 9576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "4252792d64c14f18b3c2e7265a734141"
format_stamp: "Formatted at 2026-08-05 23:03:52 on dist-test-slave-1vmg"
server_key: "ac3f8b2724cf86c88b62c2297d6c68f6"
server_key_iv: "d4dd9ae577fc99874ea8539d3ade6b7e"
server_key_version: "encryptionkey@0"
I20260805 23:03:52.394011 9576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "4252792d64c14f18b3c2e7265a734141"
format_stamp: "Formatted at 2026-08-05 23:03:52 on dist-test-slave-1vmg"
server_key: "ac3f8b2724cf86c88b62c2297d6c68f6"
server_key_iv: "d4dd9ae577fc99874ea8539d3ade6b7e"
server_key_version: "encryptionkey@0"
I20260805 23:03:52.400396 9576 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:03:52.404639 9596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:52.406378 9576 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:03:52.406633 9576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "4252792d64c14f18b3c2e7265a734141"
format_stamp: "Formatted at 2026-08-05 23:03:52 on dist-test-slave-1vmg"
server_key: "ac3f8b2724cf86c88b62c2297d6c68f6"
server_key_iv: "d4dd9ae577fc99874ea8539d3ade6b7e"
server_key_version: "encryptionkey@0"
I20260805 23:03:52.406873 9576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:52.437211 9576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:52.441769 9576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:52.442075 9576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:52.460803 9576 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:39037
I20260805 23:03:52.460826 9665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:39037 every 8 connection(s)
I20260805 23:03:52.462371 9576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:03:52.466508 9667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:52.466965 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 9576
I20260805 23:03:52.467180 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:03:52.467871 22709 external_mini_cluster.cc:1428] Setting key 8615a10d0ee5ace2a148e803574642dc
I20260805 23:03:52.481346 9667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Bootstrap starting.
Aug 05 23:03:52 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:52.485642 9667 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:52.486985 9667 log.cc:824] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:52.490823 9667 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: No bootstrap required, opened a new log
I20260805 23:03:52.493716 9672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:52.469934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50762 (local address 127.22.45.126:39037)
0805 23:03:52.470762 (+ 828us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:52.470779 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:52.470821 (+ 42us) server_negotiation.cc:407] Connection header received
0805 23:03:52.472812 (+ 1991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:52.472837 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:52.473288 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:52.473639 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:52.475586 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:52.476920 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:52.478862 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:52.479677 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:52.479848 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:52.485225 (+ 5377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:52.485234 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:52.485252 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:52.485304 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:52.489013 (+ 3709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:52.490020 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:52.490027 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:52.490034 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:52.490224 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:52.490714 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:52.490718 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:52.490719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:52.491355 (+ 636us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:52.491610 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:52.492113 (+ 503us) server_negotiation.cc:299] Negotiation successful
0805 23:03:52.492491 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":374,"threads_started":1}
I20260805 23:03:52.500249 9667 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:52.500694 9667 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:52.500814 9667 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4252792d64c14f18b3c2e7265a734141, State: Initialized, Role: FOLLOWER
I20260805 23:03:52.501502 9667 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:52.501775 9667 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:03:52.501926 9667 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:03:52.502094 9667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:52.505177 9667 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:52.505826 9667 leader_election.cc:302] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4252792d64c14f18b3c2e7265a734141; no voters:
I20260805 23:03:52.506524 9667 leader_election.cc:288] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:03:52.506666 9677 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:03:52.507417 9677 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 LEADER]: Becoming Leader. State: Replica: 4252792d64c14f18b3c2e7265a734141, State: Running, Role: LEADER
I20260805 23:03:52.508172 9677 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:52.509102 9667 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:52.511391 9680 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4252792d64c14f18b3c2e7265a734141. Latest consensus state: current_term: 1 leader_uuid: "4252792d64c14f18b3c2e7265a734141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } } }
I20260805 23:03:52.511744 9680 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:52.511487 9678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4252792d64c14f18b3c2e7265a734141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } } }
I20260805 23:03:52.511873 9678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:52.512847 9687 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:03:52.519662 9687 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:03:52.533663 9687 catalog_manager.cc:1347] Generated new cluster ID: 319ee6f4f2e443cfaf2818d5ae6bacb1
I20260805 23:03:52.533819 9687 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:03:52.549324 9687 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:03:52.551362 9687 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:03:52.560771 9687 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Generated new TSK 0
I20260805 23:03:52.561801 9687 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:03:52.643302 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39037
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:53.017287 9705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:53.017663 9705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:53.017803 9705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:53.025979 9705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:53.026139 9705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:53.026319 9705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:03:53.037308 9705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:53.038805 9705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:53.040335 9705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:53.054311 9711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:53.054378 9714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:53.054418 9712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:53.055284 9705 server_base.cc:1034] running on GCE node
I20260805 23:03:53.056016 9705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:53.057186 9705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:53.058422 9705 hybrid_clock.cc:648] HybridClock initialized: now 1785971033058373 us; error 54 us; skew 500 ppm
I20260805 23:03:53.058794 9705 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:53 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971033, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:53.062525 9705 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:03:53.064419 9705 webserver.cc:460] Webserver started at http://127.22.45.65:39793/ using document root <none> and password file <none>
I20260805 23:03:53.065240 9705 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:53.065388 9705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:53.065721 9705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:53.069168 9705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "f3147d711a0e4fe299b64baff9388885"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "2109364eba38bb6ca77769fb38e11741"
server_key_iv: "f36c5986cecf67fedbe4af8b1c708427"
server_key_version: "encryptionkey@0"
I20260805 23:03:53.070113 9705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "f3147d711a0e4fe299b64baff9388885"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "2109364eba38bb6ca77769fb38e11741"
server_key_iv: "f36c5986cecf67fedbe4af8b1c708427"
server_key_version: "encryptionkey@0"
I20260805 23:03:53.076365 9705 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:03:53.080406 9723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:53.082044 9705 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:03:53.082247 9705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "f3147d711a0e4fe299b64baff9388885"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "2109364eba38bb6ca77769fb38e11741"
server_key_iv: "f36c5986cecf67fedbe4af8b1c708427"
server_key_version: "encryptionkey@0"
I20260805 23:03:53.082472 9705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:53.103506 9705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:53.108389 9705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:53.108717 9705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:53.109884 9705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:53.111439 9705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:53.111559 9705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:53.111716 9705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:53.111771 9705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:53.145227 9705 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:32977
I20260805 23:03:53.145267 9871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:32977 every 8 connection(s)
I20260805 23:03:53.146656 9705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:03:53.155959 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 9705
I20260805 23:03:53.156200 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:03:53.156853 22709 external_mini_cluster.cc:1428] Setting key 0b231c64901291468d5d43d112cb3d6b
Aug 05 23:03:53 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971033, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:53.171155 9875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:53.149440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:42999 (local address 127.22.45.126:39037)
0805 23:03:53.149930 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:53.149934 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:53.151067 (+ 1133us) server_negotiation.cc:407] Connection header received
0805 23:03:53.153028 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:53.153035 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:53.153127 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:53.153242 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:53.155038 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.155840 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.157671 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.158132 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.158273 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:53.163225 (+ 4952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:53.163232 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:53.163235 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:53.163288 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:53.167176 (+ 3888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:53.168289 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:53.168295 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:53.168298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:53.168472 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:53.168976 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:53.168980 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:53.168982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:53.169324 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:53.169493 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:53.170433 (+ 940us) server_negotiation.cc:299] Negotiation successful
0805 23:03:53.170726 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":252,"threads_started":1}
I20260805 23:03:53.172260 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:53.150022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:42999)
0805 23:03:53.150841 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:53.150891 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:53.152687 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:53.153526 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:53.153536 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:53.154147 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:53.154805 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:53.154825 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.156034 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.156039 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:53.157491 (+ 1452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:53.157507 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.158420 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.158429 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:53.158680 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:53.159938 (+ 1258us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:53.159979 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:53.162776 (+ 2797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:53.167430 (+ 4654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:53.167442 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:53.167461 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:53.168108 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:53.168602 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:53.168606 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:53.168609 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:53.168836 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:53.169478 (+ 642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:53.169488 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:53.169964 (+ 476us) client_negotiation.cc:769] Sending connection context
0805 23:03:53.170267 (+ 303us) client_negotiation.cc:240] Negotiation successful
0805 23:03:53.170968 (+ 701us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":323,"threads_started":1}
I20260805 23:03:53.174230 9872 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39037
I20260805 23:03:53.174607 9872 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:53.175745 9872 heartbeater.cc:511] Master 127.22.45.126:39037 requested a full tablet report, sending...
I20260805 23:03:53.178725 9616 ts_manager.cc:194] Registered new tserver with Master: f3147d711a0e4fe299b64baff9388885 (127.22.45.65:32977)
I20260805 23:03:53.180968 9616 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:42999
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:03:53.222798 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39037
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:53.575662 9880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:53.575985 9880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:53.576121 9880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:53.583886 9880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:53.584045 9880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:53.584211 9880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:03:53.594693 9880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:53.596171 9880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:53.597536 9880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:53.611713 9887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:53.611661 9890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:53.611629 9888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:53.612723 9880 server_base.cc:1034] running on GCE node
I20260805 23:03:53.613405 9880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:53.614491 9880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:53.615732 9880 hybrid_clock.cc:648] HybridClock initialized: now 1785971033615677 us; error 44 us; skew 500 ppm
I20260805 23:03:53.616086 9880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:53 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971033, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:53.623685 9880 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:03:53.625382 9880 webserver.cc:460] Webserver started at http://127.22.45.66:46363/ using document root <none> and password file <none>
I20260805 23:03:53.626176 9880 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:53.626305 9880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:53.626612 9880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:53.629983 9880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "8c4a63fac3d342d28eff99df8905ed44"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "620dcf828d2020fba5b2e086a34d2795"
server_key_iv: "f8cee0f39418f4d9a586dae14b022fca"
server_key_version: "encryptionkey@0"
I20260805 23:03:53.631085 9880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "8c4a63fac3d342d28eff99df8905ed44"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "620dcf828d2020fba5b2e086a34d2795"
server_key_iv: "f8cee0f39418f4d9a586dae14b022fca"
server_key_version: "encryptionkey@0"
I20260805 23:03:53.637113 9880 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:03:53.641127 9899 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:53.642675 9880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260805 23:03:53.642864 9880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "8c4a63fac3d342d28eff99df8905ed44"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "620dcf828d2020fba5b2e086a34d2795"
server_key_iv: "f8cee0f39418f4d9a586dae14b022fca"
server_key_version: "encryptionkey@0"
I20260805 23:03:53.643148 9880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:53.683305 9880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:53.688261 9880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:53.688589 9880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:53.689652 9880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:53.691184 9880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:53.691270 9880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:53.691393 9880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:53.691442 9880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:53.724274 9880 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:45757
I20260805 23:03:53.724313 10046 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:45757 every 8 connection(s)
I20260805 23:03:53.725651 9880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:03:53.733222 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 9880
I20260805 23:03:53.733417 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:03:53.733860 22709 external_mini_cluster.cc:1428] Setting key 4827e5a8a70a0ad18f98caac89670dbf
Aug 05 23:03:53 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971033, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:53.747429 10049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:53.728265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:37907 (local address 127.22.45.126:39037)
0805 23:03:53.728687 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:53.728692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:53.729638 (+ 946us) server_negotiation.cc:407] Connection header received
0805 23:03:53.731752 (+ 2114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:53.731758 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:53.731860 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:53.731985 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:53.733758 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.734522 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.736655 (+ 2133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.737092 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.737221 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:53.741305 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:53.741311 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:53.741315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:53.741356 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:53.744042 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:53.744892 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:53.744897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:53.744899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:53.745039 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:53.745505 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:53.745509 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:53.745511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:53.745807 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:53.745953 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:53.746730 (+ 777us) server_negotiation.cc:299] Negotiation successful
0805 23:03:53.747044 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":210,"threads_started":1}
I20260805 23:03:53.748603 10051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:53.728722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:37907)
0805 23:03:53.729452 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:53.729493 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:53.731400 (+ 1907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:53.732256 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:53.732266 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:53.732869 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:53.733556 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:53.733579 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.735012 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.735016 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:53.736495 (+ 1479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:53.736509 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:53.737343 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:53.737351 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:53.737599 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:53.738343 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:53.738368 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:53.741001 (+ 2633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:53.744222 (+ 3221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:53.744232 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:53.744249 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:53.744750 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:53.745160 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:53.745166 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:53.745169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:53.745382 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:53.745953 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:53.745964 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:53.746333 (+ 369us) client_negotiation.cc:769] Sending connection context
0805 23:03:53.746591 (+ 258us) client_negotiation.cc:240] Negotiation successful
0805 23:03:53.747246 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":286,"threads_started":1}
I20260805 23:03:53.750192 10047 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39037
I20260805 23:03:53.750566 10047 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:53.751549 10047 heartbeater.cc:511] Master 127.22.45.126:39037 requested a full tablet report, sending...
I20260805 23:03:53.753337 9616 ts_manager.cc:194] Registered new tserver with Master: 8c4a63fac3d342d28eff99df8905ed44 (127.22.45.66:45757)
I20260805 23:03:53.754215 9616 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:37907
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:03:53.795833 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39037
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:54.149492 10054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:54.149827 10054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:54.149976 10054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:54.157753 10054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:54.157920 10054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:54.158097 10054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:03:54.168949 10054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:54.170487 10054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:54.172168 10054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 23:03:54.185877 9872 heartbeater.cc:503] Master 127.22.45.126:39037 was elected leader, sending a full tablet report...
W20260805 23:03:54.186466 10064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:54.186574 10062 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:54.187404 10054 server_base.cc:1034] running on GCE node
W20260805 23:03:54.188124 10066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:54.188892 10054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:54.190009 10054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:54.191236 10054 hybrid_clock.cc:648] HybridClock initialized: now 1785971034191188 us; error 53 us; skew 500 ppm
I20260805 23:03:54.191604 10054 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:54 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971034, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:54.195266 10054 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:03:54.196955 10054 webserver.cc:460] Webserver started at http://127.22.45.67:38297/ using document root <none> and password file <none>
I20260805 23:03:54.197717 10054 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:54.197850 10054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:54.198169 10054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:03:54.201344 10054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "2f120da71835445d8868826b764b9108"
format_stamp: "Formatted at 2026-08-05 23:03:54 on dist-test-slave-1vmg"
server_key: "6aa1023cd0d5bc3cb6c68058054b8733"
server_key_iv: "4c9b2e20002ee6599726e1c419b955b7"
server_key_version: "encryptionkey@0"
I20260805 23:03:54.202134 10054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "2f120da71835445d8868826b764b9108"
format_stamp: "Formatted at 2026-08-05 23:03:54 on dist-test-slave-1vmg"
server_key: "6aa1023cd0d5bc3cb6c68058054b8733"
server_key_iv: "4c9b2e20002ee6599726e1c419b955b7"
server_key_version: "encryptionkey@0"
I20260805 23:03:54.208245 10054 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260805 23:03:54.212580 10075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:54.214169 10054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260805 23:03:54.214370 10054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "2f120da71835445d8868826b764b9108"
format_stamp: "Formatted at 2026-08-05 23:03:54 on dist-test-slave-1vmg"
server_key: "6aa1023cd0d5bc3cb6c68058054b8733"
server_key_iv: "4c9b2e20002ee6599726e1c419b955b7"
server_key_version: "encryptionkey@0"
I20260805 23:03:54.214600 10054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:54.239316 10054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:54.243945 10054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:54.244254 10054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:54.245344 10054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:54.246843 10054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:54.246948 10054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:54.247084 10054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:54.247141 10054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:54.280562 10054 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46333
I20260805 23:03:54.280618 10220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46333 every 8 connection(s)
I20260805 23:03:54.281991 10054 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:03:54.285710 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 10054
I20260805 23:03:54.285902 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:03:54.286389 22709 external_mini_cluster.cc:1428] Setting key 408b2816faff96169cecaa722f61ad19
Aug 05 23:03:54 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971034, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:54.304363 10224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.284936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:53541 (local address 127.22.45.126:39037)
0805 23:03:54.285542 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.285549 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.286776 (+ 1227us) server_negotiation.cc:407] Connection header received
0805 23:03:54.288991 (+ 2215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.288997 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.289119 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.289221 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:54.291067 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.291921 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.293681 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.294110 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.294236 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.298180 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:54.298186 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:54.298189 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:54.298229 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:54.300982 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.301840 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.301844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.301847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.301979 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.302442 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.302446 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.302448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.302747 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:54.302900 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.303709 (+ 809us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.303959 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":265,"threads_started":1}
I20260805 23:03:54.305411 10226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.285603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:53541)
0805 23:03:54.286550 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:54.286608 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:54.288675 (+ 2067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:54.289509 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:54.289518 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:54.290136 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:54.290817 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.290838 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.292105 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.292109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.293484 (+ 1375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.293500 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.294376 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.294383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.294641 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.295397 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:54.295424 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:54.297872 (+ 2448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:54.301161 (+ 3289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:54.301172 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:54.301192 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:54.301702 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:54.302097 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:54.302103 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:54.302107 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:54.302320 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:54.302884 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:54.302893 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:54.303305 (+ 412us) client_negotiation.cc:769] Sending connection context
0805 23:03:54.303574 (+ 269us) client_negotiation.cc:240] Negotiation successful
0805 23:03:54.304188 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"thread_start_us":366,"threads_started":1}
I20260805 23:03:54.306823 10221 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39037
I20260805 23:03:54.307175 10221 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:54.307940 10221 heartbeater.cc:511] Master 127.22.45.126:39037 requested a full tablet report, sending...
I20260805 23:03:54.309464 9616 ts_manager.cc:194] Registered new tserver with Master: 2f120da71835445d8868826b764b9108 (127.22.45.67:46333)
I20260805 23:03:54.310316 9616 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:53541
I20260805 23:03:54.314118 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:03:54.331990 10224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.318654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.22.45.126:39037)
0805 23:03:54.318876 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.318883 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.319353 (+ 470us) server_negotiation.cc:407] Connection header received
0805 23:03:54.319554 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.319558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.319627 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.319708 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:54.321257 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.322015 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.323416 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.323825 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.323943 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.326472 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:54.326477 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:54.326481 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:54.326520 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:54.329067 (+ 2547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.329816 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.329821 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.329825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.329963 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.330339 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.330343 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.330345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.330771 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:54.331043 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.331409 (+ 366us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.331669 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 23:03:54.336388 9616 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50764:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:03:54.343677 9616 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:03:54.380409 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.358588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59436 (local address 127.22.45.66:45757)
0805 23:03:54.366089 (+ 7501us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.366100 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.372605 (+ 6505us) server_negotiation.cc:407] Connection header received
0805 23:03:54.372944 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.372952 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.373182 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.373349 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:54.374258 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.375565 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.377989 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.379101 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.379239 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.379472 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.379853 (+ 381us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.380049 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7279,"thread_start_us":7122,"threads_started":1}
I20260805 23:03:54.380863 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.358190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56824 (local address 127.22.45.67:46333)
0805 23:03:54.366143 (+ 7953us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.366150 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.371950 (+ 5800us) server_negotiation.cc:407] Connection header received
0805 23:03:54.372089 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.372097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.372339 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.372562 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:54.373525 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.374950 (+ 1425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.378022 (+ 3072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.379507 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.379667 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.379928 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.380121 (+ 193us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.380318 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7762,"thread_start_us":7813,"threads_started":1}
I20260805 23:03:54.380905 10241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.357299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46333 (local address 127.0.0.1:56824)
0805 23:03:54.371761 (+ 14462us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:54.371782 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:54.371934 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:54.372857 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:54.372862 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:54.372890 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:54.373315 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.373329 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.375081 (+ 1752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.375086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.377796 (+ 2710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.377813 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.379751 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.379758 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.379921 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.379954 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:03:54.380043 (+ 89us) client_negotiation.cc:240] Negotiation successful
0805 23:03:54.380280 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14324,"mutex_wait_us":128,"thread_start_us":12501,"threads_started":1}
I20260805 23:03:54.381659 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.357564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:45757 (local address 127.0.0.1:59436)
0805 23:03:54.372458 (+ 14894us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:54.372481 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:54.372725 (+ 244us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:54.373641 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:54.373646 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:54.373673 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:54.374055 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.374068 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.375706 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.375710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.377756 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.377785 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.379318 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.379325 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.379537 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.379579 (+ 42us) client_negotiation.cc:769] Sending connection context
0805 23:03:54.380672 (+ 1093us) client_negotiation.cc:240] Negotiation successful
0805 23:03:54.380824 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14759,"mutex_wait_us":23,"thread_start_us":13903,"threads_started":1}
I20260805 23:03:54.382218 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.356917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:32977 (local address 127.0.0.1:41408)
0805 23:03:54.370269 (+ 13352us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:54.370320 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:54.370595 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:54.372154 (+ 1559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:54.372163 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:54.372209 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:54.372812 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.372825 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.374960 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.374966 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.377910 (+ 2944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.377921 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.381414 (+ 3493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.381422 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.381611 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.381648 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 23:03:54.381715 (+ 67us) client_negotiation.cc:240] Negotiation successful
0805 23:03:54.381850 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13050,"mutex_wait_us":400,"thread_start_us":15249,"threads_started":1}
I20260805 23:03:54.383334 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.357222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41408 (local address 127.22.45.65:32977)
0805 23:03:54.371369 (+ 14147us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.371379 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.371414 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:03:54.371529 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.371549 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.371857 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.373034 (+ 1177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:54.373338 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.374791 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.378109 (+ 3318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.379558 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.382457 (+ 2899us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.382689 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.382781 (+ 92us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.382986 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13982,"thread_start_us":13816,"threads_started":1}
I20260805 23:03:54.385219 10136 tablet_service.cc:1467] Processing CreateTablet for tablet 1c936055a8914d2d9be384e7d0631a07 (DEFAULT_TABLE table=test-table [id=4093c3b14f614d74a7e863dbffe87a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:54.385216 9964 tablet_service.cc:1467] Processing CreateTablet for tablet 1c936055a8914d2d9be384e7d0631a07 (DEFAULT_TABLE table=test-table [id=4093c3b14f614d74a7e863dbffe87a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:54.386844 9964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c936055a8914d2d9be384e7d0631a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:54.386868 10136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c936055a8914d2d9be384e7d0631a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:54.387099 9789 tablet_service.cc:1467] Processing CreateTablet for tablet 1c936055a8914d2d9be384e7d0631a07 (DEFAULT_TABLE table=test-table [id=4093c3b14f614d74a7e863dbffe87a26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:54.388787 9789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c936055a8914d2d9be384e7d0631a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:54.399667 10245 tablet_bootstrap.cc:492] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Bootstrap starting.
I20260805 23:03:54.401962 10246 tablet_bootstrap.cc:492] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Bootstrap starting.
I20260805 23:03:54.403775 10245 tablet_bootstrap.cc:654] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:54.403769 10247 tablet_bootstrap.cc:492] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Bootstrap starting.
I20260805 23:03:54.405860 10246 tablet_bootstrap.cc:654] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:54.405853 10245 log.cc:824] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:54.407240 10246 log.cc:824] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:54.407526 10247 tablet_bootstrap.cc:654] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:54.408803 10247 log.cc:824] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:54.409447 10245 tablet_bootstrap.cc:492] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: No bootstrap required, opened a new log
I20260805 23:03:54.409847 10245 ts_tablet_manager.cc:1397] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260805 23:03:54.410701 10246 tablet_bootstrap.cc:492] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: No bootstrap required, opened a new log
I20260805 23:03:54.411170 10246 ts_tablet_manager.cc:1397] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.002s
I20260805 23:03:54.411751 10247 tablet_bootstrap.cc:492] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: No bootstrap required, opened a new log
I20260805 23:03:54.412021 10247 ts_tablet_manager.cc:1397] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.006s
I20260805 23:03:54.420397 10247 raft_consensus.cc:348] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.420855 10247 raft_consensus.cc:374] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:54.420951 10247 raft_consensus.cc:729] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3147d711a0e4fe299b64baff9388885, State: Initialized, Role: FOLLOWER
I20260805 23:03:54.421275 10245 raft_consensus.cc:348] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.421759 10245 raft_consensus.cc:374] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:54.421602 10247 consensus_queue.cc:260] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.421873 10245 raft_consensus.cc:729] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c4a63fac3d342d28eff99df8905ed44, State: Initialized, Role: FOLLOWER
I20260805 23:03:54.422048 10246 raft_consensus.cc:348] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.422490 10246 raft_consensus.cc:374] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:54.422607 10246 raft_consensus.cc:729] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f120da71835445d8868826b764b9108, State: Initialized, Role: FOLLOWER
I20260805 23:03:54.422663 10245 consensus_queue.cc:260] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.423866 10047 heartbeater.cc:503] Master 127.22.45.126:39037 was elected leader, sending a full tablet report...
I20260805 23:03:54.425179 10247 ts_tablet_manager.cc:1428] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260805 23:03:54.424959 10246 consensus_queue.cc:260] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.426610 10221 heartbeater.cc:503] Master 127.22.45.126:39037 was elected leader, sending a full tablet report...
I20260805 23:03:54.427498 10246 ts_tablet_manager.cc:1428] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Time spent starting tablet: real 0.016s user 0.007s sys 0.006s
I20260805 23:03:54.428808 10245 ts_tablet_manager.cc:1428] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Time spent starting tablet: real 0.019s user 0.010s sys 0.005s
W20260805 23:03:54.477754 10048 tablet.cc:2369] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:03:54.533772 10223 tablet.cc:2369] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:03:54.649365 9873 tablet.cc:2369] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:03:54.666735 10255 raft_consensus.cc:482] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:03:54.667125 10255 raft_consensus.cc:504] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.668932 10255 leader_election.cc:288] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f3147d711a0e4fe299b64baff9388885 (127.22.45.65:32977), 2f120da71835445d8868826b764b9108 (127.22.45.67:46333)
I20260805 23:03:54.676687 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.669576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:47509 (local address 127.22.45.67:46333)
0805 23:03:54.669809 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.669814 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.670742 (+ 928us) server_negotiation.cc:407] Connection header received
0805 23:03:54.670945 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.670950 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.671026 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.671114 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:54.671874 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.672644 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.674727 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.675648 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.675809 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.675895 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.676264 (+ 369us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.676412 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260805 23:03:54.676687 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.669559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:34317 (local address 127.22.45.65:32977)
0805 23:03:54.669805 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.669812 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.670585 (+ 773us) server_negotiation.cc:407] Connection header received
0805 23:03:54.670835 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.670841 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.670950 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.671017 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:54.671912 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.672840 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.674817 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.675705 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.675865 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.675944 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.676285 (+ 341us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.676427 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260805 23:03:54.676884 10259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.669259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:32977 (local address 127.22.45.66:34317)
0805 23:03:54.670472 (+ 1213us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:54.670493 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:54.670659 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:54.671229 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:54.671237 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:54.671356 (+ 119us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:54.671771 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.671780 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.673040 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.673045 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.674625 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.674639 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.675946 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.675953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.676120 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.676145 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 23:03:54.676226 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 23:03:54.676412 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1066,"mutex_wait_us":46,"spinlock_wait_cycles":38144,"thread_start_us":961,"threads_started":1}
I20260805 23:03:54.676937 10258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.669259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46333 (local address 127.22.45.66:47509)
0805 23:03:54.670610 (+ 1351us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:54.670630 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:54.670786 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:54.671149 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:54.671153 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:54.671178 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:54.671672 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.671687 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.672788 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.672792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.674534 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:54.674549 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.675913 (+ 1364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.675920 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:54.676091 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.676128 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 23:03:54.676216 (+ 88us) client_negotiation.cc:240] Negotiation successful
0805 23:03:54.676423 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1220,"mutex_wait_us":291,"spinlock_wait_cycles":38144,"thread_start_us":517,"threads_started":1}
I20260805 23:03:54.678038 10163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c936055a8914d2d9be384e7d0631a07" candidate_uuid: "8c4a63fac3d342d28eff99df8905ed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f120da71835445d8868826b764b9108" is_pre_election: true
I20260805 23:03:54.678051 9814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c936055a8914d2d9be384e7d0631a07" candidate_uuid: "8c4a63fac3d342d28eff99df8905ed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3147d711a0e4fe299b64baff9388885" is_pre_election: true
I20260805 23:03:54.678561 10163 raft_consensus.cc:2454] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c4a63fac3d342d28eff99df8905ed44 in term 0.
I20260805 23:03:54.678561 9814 raft_consensus.cc:2454] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c4a63fac3d342d28eff99df8905ed44 in term 0.
I20260805 23:03:54.679312 9903 leader_election.cc:302] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c4a63fac3d342d28eff99df8905ed44, f3147d711a0e4fe299b64baff9388885; no voters:
I20260805 23:03:54.679778 10255 raft_consensus.cc:2781] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:03:54.679955 10255 raft_consensus.cc:482] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:03:54.680061 10255 raft_consensus.cc:3037] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:54.682440 10255 raft_consensus.cc:504] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.683204 10255 leader_election.cc:288] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [CANDIDATE]: Term 1 election: Requested vote from peers f3147d711a0e4fe299b64baff9388885 (127.22.45.65:32977), 2f120da71835445d8868826b764b9108 (127.22.45.67:46333)
I20260805 23:03:54.683797 9814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c936055a8914d2d9be384e7d0631a07" candidate_uuid: "8c4a63fac3d342d28eff99df8905ed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3147d711a0e4fe299b64baff9388885"
I20260805 23:03:54.683806 10163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c936055a8914d2d9be384e7d0631a07" candidate_uuid: "8c4a63fac3d342d28eff99df8905ed44" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f120da71835445d8868826b764b9108"
I20260805 23:03:54.684019 9814 raft_consensus.cc:3037] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:54.684018 10163 raft_consensus.cc:3037] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:54.686502 9814 raft_consensus.cc:2454] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c4a63fac3d342d28eff99df8905ed44 in term 1.
I20260805 23:03:54.686512 10163 raft_consensus.cc:2454] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c4a63fac3d342d28eff99df8905ed44 in term 1.
I20260805 23:03:54.687089 9906 leader_election.cc:302] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f120da71835445d8868826b764b9108, 8c4a63fac3d342d28eff99df8905ed44; no voters:
I20260805 23:03:54.687451 10255 raft_consensus.cc:2781] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:03:54.687919 10255 raft_consensus.cc:686] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 1 LEADER]: Becoming Leader. State: Replica: 8c4a63fac3d342d28eff99df8905ed44, State: Running, Role: LEADER
I20260805 23:03:54.688474 10255 consensus_queue.cc:237] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:54.693799 9616 catalog_manager.cc:5495] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c4a63fac3d342d28eff99df8905ed44 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "8c4a63fac3d342d28eff99df8905ed44" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } health_report { overall_health: HEALTHY } } }
I20260805 23:03:54.755293 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.749931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52500 (local address 127.22.45.66:45757)
0805 23:03:54.750140 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.750145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.750167 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:03:54.750367 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.750370 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.750458 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.750590 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:03:54.750972 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.751698 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.753093 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.753507 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.753606 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.754097 (+ 491us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:03:54.754677 (+ 580us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:03:54.754805 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.754851 (+ 46us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.754984 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 23:03:54.764477 10163 raft_consensus.cc:1261] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Refusing update from remote peer 8c4a63fac3d342d28eff99df8905ed44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:54.764477 9814 raft_consensus.cc:1261] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 1 FOLLOWER]: Refusing update from remote peer 8c4a63fac3d342d28eff99df8905ed44: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:54.765589 10260 consensus_queue.cc:1035] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:54.765997 10255 consensus_queue.cc:1035] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:54.778398 10264 mvcc.cc:205] Tried to move back new op lower bound from 7315337358384418816 to 7315337358088200192. Current Snapshot: MvccSnapshot[applied={T|T < 7315337358384418816}]
I20260805 23:03:54.795917 9616 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:03:54.796288 9616 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50764:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:03:54.800698 9616 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Sending DeleteTablet for 3 replicas of tablet 1c936055a8914d2d9be384e7d0631a07
I20260805 23:03:54.802182 10136 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c936055a8914d2d9be384e7d0631a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:54 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:56824
I20260805 23:03:54.802182 9789 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c936055a8914d2d9be384e7d0631a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:54 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:41408
I20260805 23:03:54.802755 9964 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c936055a8914d2d9be384e7d0631a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:54 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:59436
I20260805 23:03:54.804114 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 9705
I20260805 23:03:54.819378 10284 tablet_replica.cc:330] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: stopping tablet replica
I20260805 23:03:54.820250 10284 raft_consensus.cc:2229] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:03:54.821250 10284 raft_consensus.cc:2258] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:54.822561 10283 tablet_replica.cc:330] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: stopping tablet replica
I20260805 23:03:54.823263 10282 tablet_replica.cc:330] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: stopping tablet replica
I20260805 23:03:54.823886 10283 raft_consensus.cc:2229] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:03:54.824379 10284 ts_tablet_manager.cc:1905] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:54.824460 10282 raft_consensus.cc:2229] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:03:54.825207 10282 raft_consensus.cc:2258] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:54.825814 10283 raft_consensus.cc:2258] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:54.829245 10282 ts_tablet_manager.cc:1905] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 05 23:03:54 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:03:54.832751 10284 ts_tablet_manager.cc:1918] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:54.832860 10283 ts_tablet_manager.cc:1905] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:54.832970 10284 log.cc:1196] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/1c936055a8914d2d9be384e7d0631a07
I20260805 23:03:54.833752 10284 ts_tablet_manager.cc:1939] T 1c936055a8914d2d9be384e7d0631a07 P 8c4a63fac3d342d28eff99df8905ed44: Deleting consensus metadata
I20260805 23:03:54.836107 9599 catalog_manager.cc:4841] TS 8c4a63fac3d342d28eff99df8905ed44 (127.22.45.66:45757): tablet 1c936055a8914d2d9be384e7d0631a07 (table test-table [id=4093c3b14f614d74a7e863dbffe87a26]) successfully deleted
I20260805 23:03:54.837514 10282 ts_tablet_manager.cc:1918] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:54.837720 10282 log.cc:1196] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/1c936055a8914d2d9be384e7d0631a07
I20260805 23:03:54.838271 10282 ts_tablet_manager.cc:1939] T 1c936055a8914d2d9be384e7d0631a07 P f3147d711a0e4fe299b64baff9388885: Deleting consensus metadata
I20260805 23:03:54.840509 9600 catalog_manager.cc:4841] TS f3147d711a0e4fe299b64baff9388885 (127.22.45.65:32977): tablet 1c936055a8914d2d9be384e7d0631a07 (table test-table [id=4093c3b14f614d74a7e863dbffe87a26]) successfully deleted
I20260805 23:03:54.840708 10283 ts_tablet_manager.cc:1918] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:54.840909 10283 log.cc:1196] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/1c936055a8914d2d9be384e7d0631a07
I20260805 23:03:54.841185 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.805564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59596 (local address 127.22.45.65:32977)
0805 23:03:54.805784 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.805792 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.812951 (+ 7159us) server_negotiation.cc:407] Connection header received
0805 23:03:54.814374 (+ 1423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.814383 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.814534 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.814624 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:54.820318 (+ 5694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.821777 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.825217 (+ 3440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.825902 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.826018 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.832591 (+ 6573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:54.832613 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:54.832632 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:54.832684 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:54.837059 (+ 4375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.838080 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.838091 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.838095 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.838297 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.838841 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.838847 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.838850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.839408 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:54.839806 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.840507 (+ 701us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.840790 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 23:03:54.841496 10283 ts_tablet_manager.cc:1939] T 1c936055a8914d2d9be384e7d0631a07 P 2f120da71835445d8868826b764b9108: Deleting consensus metadata
I20260805 23:03:54.842356 9867 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:54.843394 9601 catalog_manager.cc:4841] TS 2f120da71835445d8868826b764b9108 (127.22.45.67:46333): tablet 1c936055a8914d2d9be384e7d0631a07 (table test-table [id=4093c3b14f614d74a7e863dbffe87a26]) successfully deleted
I20260805 23:03:54.933856 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 9705
I20260805 23:03:54.960197 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 9880
Aug 05 23:03:54 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:03:54.978032 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:54.961002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52512 (local address 127.22.45.66:45757)
0805 23:03:54.961212 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:54.961218 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:54.961238 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:03:54.961333 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:54.961339 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:54.961412 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:54.961498 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:54.962959 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.963807 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.965154 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:54.965636 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:54.965760 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:54.971101 (+ 5341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:54.971122 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:54.971140 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:54.971199 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:54.974579 (+ 3380us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.975628 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.975637 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.975639 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.975835 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:54.976258 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:54.976262 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:54.976264 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:54.976672 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:54.977065 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:54.977376 (+ 311us) server_negotiation.cc:299] Negotiation successful
0805 23:03:54.977638 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260805 23:03:54.978829 10037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:55.096107 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 9880
I20260805 23:03:55.118275 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 10054
Aug 05 23:03:55 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:03:55.135474 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:55.119098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44208 (local address 127.22.45.67:46333)
0805 23:03:55.119293 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:55.119300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:55.119406 (+ 106us) server_negotiation.cc:407] Connection header received
0805 23:03:55.119604 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:55.119609 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:55.119676 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:55.119816 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:55.121294 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:55.122040 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:55.123559 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:55.124115 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:55.124255 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:55.129130 (+ 4875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:55.129160 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:55.129178 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:55.129221 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:55.132305 (+ 3084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:55.133200 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:55.133207 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:55.133209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:55.133362 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:55.133787 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:55.133794 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:55.133798 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:55.134242 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:55.134521 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:55.134846 (+ 325us) server_negotiation.cc:299] Negotiation successful
0805 23:03:55.135111 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 23:03:55.136214 10216 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:55.227125 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 10054
I20260805 23:03:55.250200 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 9576
I20260805 23:03:55.251523 9661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:55.367624 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 9576
I20260805 23:03:55.397089 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39037
--webserver_interface=127.22.45.126
--webserver_port=41273
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39037
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:55.755025 10292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:55.755399 10292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:55.755507 10292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:55.763337 10292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:55.763478 10292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:55.763535 10292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:55.763600 10292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:55.763646 10292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:55.774158 10292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=41273
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:55.775588 10292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:55.776940 10292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:55.802736 10298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:55.802693 10301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:55.802763 10299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:55.803671 10292 server_base.cc:1034] running on GCE node
I20260805 23:03:55.804669 10292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:55.806618 10292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:55.807852 10292 hybrid_clock.cc:648] HybridClock initialized: now 1785971035807771 us; error 82 us; skew 500 ppm
I20260805 23:03:55.808317 10292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:55 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971035, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:55.812376 10292 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:03:55.814349 10292 webserver.cc:460] Webserver started at http://127.22.45.126:41273/ using document root <none> and password file <none>
I20260805 23:03:55.815346 10292 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:55.815500 10292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:55.822849 10292 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.005s
I20260805 23:03:55.826577 10320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:55.828359 10292 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:03:55.828567 10292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "4252792d64c14f18b3c2e7265a734141"
format_stamp: "Formatted at 2026-08-05 23:03:52 on dist-test-slave-1vmg"
server_key: "ac3f8b2724cf86c88b62c2297d6c68f6"
server_key_iv: "d4dd9ae577fc99874ea8539d3ade6b7e"
server_key_version: "encryptionkey@0"
I20260805 23:03:55.829820 10292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:55.852145 10292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:55.857095 10292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:55.857393 10292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:55.877485 10292 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:39037
I20260805 23:03:55.877490 10385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:39037 every 8 connection(s)
I20260805 23:03:55.879259 10292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:03:55.886881 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 10292
I20260805 23:03:55.887041 10386 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:03:55.887970 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:32977
--local_ip_for_outbound_sockets=127.22.45.65
--tserver_master_addrs=127.22.45.126:39037
--webserver_port=39793
--webserver_interface=127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:03:55.892100 10386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Bootstrap starting.
I20260805 23:03:55.915130 10386 log.cc:824] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:55.929531 10386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:03:55.930163 10386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Bootstrap complete.
I20260805 23:03:55.940340 10386 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:55.941313 10386 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4252792d64c14f18b3c2e7265a734141, State: Initialized, Role: FOLLOWER
I20260805 23:03:55.942032 10386 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:55.942303 10386 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:03:55.942433 10386 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:03:55.942591 10386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 1 FOLLOWER]: Advancing to term 2
I20260805 23:03:55.947052 10386 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:55.947722 10386 leader_election.cc:302] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4252792d64c14f18b3c2e7265a734141; no voters:
I20260805 23:03:55.948414 10386 leader_election.cc:288] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 23:03:55.948572 10390 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 23:03:55.949852 10390 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 LEADER]: Becoming Leader. State: Replica: 4252792d64c14f18b3c2e7265a734141, State: Running, Role: LEADER
I20260805 23:03:55.950518 10390 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:55.951072 10386 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:55.953891 10391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4252792d64c14f18b3c2e7265a734141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } } }
I20260805 23:03:55.953976 10392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4252792d64c14f18b3c2e7265a734141. Latest consensus state: current_term: 2 leader_uuid: "4252792d64c14f18b3c2e7265a734141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } } }
I20260805 23:03:55.954384 10392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:55.954389 10391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:55.964937 10400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:03:55.976974 10400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:03:55.978730 10400 catalog_manager.cc:1259] Loaded cluster ID: 319ee6f4f2e443cfaf2818d5ae6bacb1
I20260805 23:03:55.978878 10400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:03:55.982297 10400 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260805 23:03:55.999441 10400 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260805 23:03:56.009794 10400 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:03:56.011703 10400 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Loaded TSK: 0
I20260805 23:03:56.013391 10400 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 23:03:56.275743 10388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:56.276055 10388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:56.276181 10388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:56.283912 10388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:56.284055 10388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:56.284209 10388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:03:56.295020 10388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:32977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=39793
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:56.296478 10388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:56.297902 10388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:56.313020 10420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:56.313182 10424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:56.313541 10419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:56.314146 10388 server_base.cc:1034] running on GCE node
I20260805 23:03:56.314851 10388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:56.316045 10388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:56.317267 10388 hybrid_clock.cc:648] HybridClock initialized: now 1785971036317203 us; error 62 us; skew 500 ppm
I20260805 23:03:56.317606 10388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:56 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971036, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:56.321347 10388 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:03:56.323385 10388 webserver.cc:460] Webserver started at http://127.22.45.65:39793/ using document root <none> and password file <none>
I20260805 23:03:56.324476 10388 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:56.324668 10388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:56.332471 10388 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:03:56.336557 10433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:56.338456 10388 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260805 23:03:56.338682 10388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "f3147d711a0e4fe299b64baff9388885"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "2109364eba38bb6ca77769fb38e11741"
server_key_iv: "f36c5986cecf67fedbe4af8b1c708427"
server_key_version: "encryptionkey@0"
I20260805 23:03:56.340221 10388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:56.364218 10388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:56.368669 10388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:56.368927 10388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:56.370047 10388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:56.371526 10388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:56.371636 10388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:56.371737 10388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:56.371795 10388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:56.403901 10388 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:32977
I20260805 23:03:56.403959 10593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:32977 every 8 connection(s)
I20260805 23:03:56.405450 10388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:03:56.411002 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 10388
I20260805 23:03:56.411653 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:45757
--local_ip_for_outbound_sockets=127.22.45.66
--tserver_master_addrs=127.22.45.126:39037
--webserver_port=46363
--webserver_interface=127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:03:56 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971036, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:56.433095 10598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:56.408657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:57715)
0805 23:03:56.409526 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:56.409584 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:56.411427 (+ 1843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:56.413261 (+ 1834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:56.413271 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:56.413949 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:56.414617 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:56.414638 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.416972 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.416978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:56.418874 (+ 1896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:56.418892 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.420277 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.420285 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:56.420558 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:56.421360 (+ 802us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:56.421396 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:56.424257 (+ 2861us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:56.428707 (+ 4450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:56.428717 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:56.428731 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:56.429253 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:56.429796 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:56.429799 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:56.429801 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:56.429996 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:56.430951 (+ 955us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:56.430960 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:56.431313 (+ 353us) client_negotiation.cc:769] Sending connection context
0805 23:03:56.431560 (+ 247us) client_negotiation.cc:240] Negotiation successful
0805 23:03:56.432010 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":342,"threads_started":1}
I20260805 23:03:56.433512 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:56.408432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:57715 (local address 127.22.45.126:39037)
0805 23:03:56.409001 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:56.409013 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:56.409701 (+ 688us) server_negotiation.cc:407] Connection header received
0805 23:03:56.412115 (+ 2414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:56.412134 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:56.412641 (+ 507us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:56.413065 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:56.414894 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.416736 (+ 1842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.419085 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.419971 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.420171 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:56.424584 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:56.424594 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:56.424613 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:56.424660 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:56.428491 (+ 3831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:56.429439 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:56.429448 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:56.429455 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:56.429684 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:56.430113 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:56.430117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:56.430120 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:56.430790 (+ 670us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:56.431087 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:56.431821 (+ 734us) server_negotiation.cc:299] Negotiation successful
0805 23:03:56.432321 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":244,"threads_started":1}
I20260805 23:03:56.436568 10594 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39037
I20260805 23:03:56.436918 10594 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:56.437914 10594 heartbeater.cc:511] Master 127.22.45.126:39037 requested a full tablet report, sending...
I20260805 23:03:56.440595 10342 ts_manager.cc:194] Registered new tserver with Master: f3147d711a0e4fe299b64baff9388885 (127.22.45.65:32977)
I20260805 23:03:56.442157 10342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:57715
W20260805 23:03:56.769683 10599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:56.769999 10599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:56.770118 10599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:56.777554 10599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:56.777679 10599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:56.777839 10599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:03:56.788002 10599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:45757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=46363
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:56.789434 10599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:56.790822 10599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:56.804229 10606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:56.804181 10608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:56.804284 10610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:56.805362 10599 server_base.cc:1034] running on GCE node
I20260805 23:03:56.806002 10599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:56.807072 10599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:56.808287 10599 hybrid_clock.cc:648] HybridClock initialized: now 1785971036808235 us; error 48 us; skew 500 ppm
I20260805 23:03:56.808612 10599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:56 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971036, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:56.811751 10599 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:03:56.813190 10599 webserver.cc:460] Webserver started at http://127.22.45.66:46363/ using document root <none> and password file <none>
I20260805 23:03:56.813901 10599 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:56.814044 10599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:56.819842 10599 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:03:56.822703 10618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:56.824241 10599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 23:03:56.824419 10599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "8c4a63fac3d342d28eff99df8905ed44"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "620dcf828d2020fba5b2e086a34d2795"
server_key_iv: "f8cee0f39418f4d9a586dae14b022fca"
server_key_version: "encryptionkey@0"
I20260805 23:03:56.825479 10599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:56.845758 10599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:56.849928 10599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:56.850201 10599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:56.851250 10599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:56.852718 10599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:56.852828 10599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:56.852942 10599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:56.853032 10599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:56.885341 10599 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:45757
I20260805 23:03:56.885365 10768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:45757 every 8 connection(s)
I20260805 23:03:56.887244 10599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:03:56.897399 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 10599
I20260805 23:03:56.898217 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:46333
--local_ip_for_outbound_sockets=127.22.45.67
--tserver_master_addrs=127.22.45.126:39037
--webserver_port=38297
--webserver_interface=127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:03:56 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971036, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:56.909365 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:56.890105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:45405 (local address 127.22.45.126:39037)
0805 23:03:56.890280 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:56.890285 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:56.891637 (+ 1352us) server_negotiation.cc:407] Connection header received
0805 23:03:56.893508 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:56.893514 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:56.893649 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:56.893745 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:56.895454 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.896204 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.898416 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.898902 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.899055 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:56.903450 (+ 4395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:56.903456 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:56.903459 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:56.903496 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:56.906053 (+ 2557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:56.906868 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:56.906873 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:56.906875 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:56.907071 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:56.907540 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:56.907544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:56.907547 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:56.907841 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:56.907992 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:56.908757 (+ 765us) server_negotiation.cc:299] Negotiation successful
0805 23:03:56.909019 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 23:03:56.910452 10771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:56.890649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:45405)
0805 23:03:56.891451 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:56.891498 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:56.893201 (+ 1703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:56.894032 (+ 831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:56.894041 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:56.894603 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:56.895251 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:56.895270 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.896395 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.896399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:56.898201 (+ 1802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:56.898221 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:56.899222 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:56.899231 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:56.899545 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:56.900348 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:56.900389 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:56.903167 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:56.906221 (+ 3054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:56.906232 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:56.906252 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:56.906724 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:56.907189 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:56.907194 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:56.907198 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:56.907409 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:56.907971 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:56.907980 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:56.908370 (+ 390us) client_negotiation.cc:769] Sending connection context
0805 23:03:56.908630 (+ 260us) client_negotiation.cc:240] Negotiation successful
0805 23:03:56.909227 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":344,"threads_started":1}
I20260805 23:03:56.912125 10769 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39037
I20260805 23:03:56.912492 10769 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:56.913475 10769 heartbeater.cc:511] Master 127.22.45.126:39037 requested a full tablet report, sending...
I20260805 23:03:56.915423 10342 ts_manager.cc:194] Registered new tserver with Master: 8c4a63fac3d342d28eff99df8905ed44 (127.22.45.66:45757)
I20260805 23:03:56.916486 10342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:45405
W20260805 23:03:57.258695 10772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:57.259120 10772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:57.259260 10772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:57.266882 10772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:57.267091 10772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:57.267233 10772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:03:57.277678 10772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:46333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=38297
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:57.279194 10772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:57.280675 10772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:57.295289 10778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:57.295295 10782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:57.295225 10780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:57.296393 10772 server_base.cc:1034] running on GCE node
I20260805 23:03:57.297101 10772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:57.298242 10772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:57.299469 10772 hybrid_clock.cc:648] HybridClock initialized: now 1785971037299414 us; error 45 us; skew 500 ppm
I20260805 23:03:57.299840 10772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:57 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971037, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:57.303440 10772 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:03:57.305150 10772 webserver.cc:460] Webserver started at http://127.22.45.67:38297/ using document root <none> and password file <none>
I20260805 23:03:57.305959 10772 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:57.306118 10772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:57.312582 10772 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.003s
I20260805 23:03:57.315639 10792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:57.317202 10772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:03:57.317381 10772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "2f120da71835445d8868826b764b9108"
format_stamp: "Formatted at 2026-08-05 23:03:54 on dist-test-slave-1vmg"
server_key: "6aa1023cd0d5bc3cb6c68058054b8733"
server_key_iv: "4c9b2e20002ee6599726e1c419b955b7"
server_key_version: "encryptionkey@0"
I20260805 23:03:57.318454 10772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:57.351939 10772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:57.356268 10772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:57.356551 10772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:57.357591 10772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:57.359068 10772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:57.359179 10772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:57.359297 10772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:57.359371 10772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:57.392295 10772 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46333
I20260805 23:03:57.392375 10944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46333 every 8 connection(s)
I20260805 23:03:57.393893 10772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:03:57.401296 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 10772
Aug 05 23:03:57 dist-test-slave-1vmg krb5kdc[9561](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971037, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:03:57.417227 10596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.396648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:40495 (local address 127.22.45.126:39037)
0805 23:03:57.396835 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.396840 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.398111 (+ 1271us) server_negotiation.cc:407] Connection header received
0805 23:03:57.400217 (+ 2106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.400223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.400310 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.400401 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:57.402453 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.403557 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.405924 (+ 2367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.406361 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.406471 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.410446 (+ 3975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:57.410453 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:57.410459 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:57.410500 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:57.413723 (+ 3223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:57.414622 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:57.414626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:57.414628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:57.414760 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:57.415245 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:57.415250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:57.415253 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:57.415626 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:57.415753 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.416643 (+ 890us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.416887 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 23:03:57.418066 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.402374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.22.45.126:39037)
0805 23:03:57.403188 (+ 814us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.403194 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.403224 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:03:57.403278 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.403283 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.403357 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.403475 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:57.405074 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.405829 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.407733 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.408378 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.408505 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.411617 (+ 3112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:57.411624 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:57.411629 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:57.411675 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:57.414760 (+ 3085us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:57.415657 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:57.415661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:57.415663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:57.415811 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:57.416226 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:57.416232 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:57.416234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:57.416607 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:57.416850 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.417197 (+ 347us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.417718 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":701,"thread_start_us":587,"threads_started":1}
I20260805 23:03:57.418527 10948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.397173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:40495)
0805 23:03:57.397926 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:57.397968 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:57.399922 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:57.400667 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:57.400676 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:57.401464 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:03:57.402277 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.402299 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.403760 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.403765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.405753 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.405785 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.406606 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.406614 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.406834 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.407575 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:03:57.407598 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:03:57.410214 (+ 2616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:03:57.413868 (+ 3654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:57.413877 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:57.413895 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:57.414513 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:57.414872 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:03:57.414877 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:03:57.414881 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:03:57.415146 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:03:57.415749 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:03:57.415758 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:03:57.416190 (+ 432us) client_negotiation.cc:769] Sending connection context
0805 23:03:57.416528 (+ 338us) client_negotiation.cc:240] Negotiation successful
0805 23:03:57.417081 (+ 553us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":302,"threads_started":1}
I20260805 23:03:57.420011 10946 heartbeater.cc:347] Connected to a master server at 127.22.45.126:39037
I20260805 23:03:57.420320 10946 heartbeater.cc:464] Registering TS with master...
I20260805 23:03:57.421136 10946 heartbeater.cc:511] Master 127.22.45.126:39037 requested a full tablet report, sending...
I20260805 23:03:57.422585 10342 ts_manager.cc:194] Registered new tserver with Master: 2f120da71835445d8868826b764b9108 (127.22.45.67:46333)
I20260805 23:03:57.423565 10342 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:40495
I20260805 23:03:57.433713 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:03:57.441242 10950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.434892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50972 (local address 127.22.45.126:39037)
0805 23:03:57.435118 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.435122 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.435578 (+ 456us) server_negotiation.cc:407] Connection header received
0805 23:03:57.435796 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.435800 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.435978 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.436130 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:03:57.436536 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.437257 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.438842 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.439435 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.439543 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.440124 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:03:57.440734 (+ 610us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:03:57.440854 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.440914 (+ 60us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.441003 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 23:03:57.446666 10594 heartbeater.cc:503] Master 127.22.45.126:39037 was elected leader, sending a full tablet report...
I20260805 23:03:57.442381 10342 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:50972:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:03:57.450655 10342 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:03:57.486454 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.463374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59602 (local address 127.22.45.65:32977)
0805 23:03:57.476963 (+ 13589us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.476972 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.476999 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:03:57.477101 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.477109 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.477341 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.477828 (+ 487us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:57.478993 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.480588 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.483919 (+ 3331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.485309 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.485444 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.485609 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.485889 (+ 280us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.486078 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13397,"thread_start_us":14146,"threads_started":1}
I20260805 23:03:57.486747 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.463088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:32977 (local address 127.0.0.1:59602)
0805 23:03:57.474954 (+ 11866us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:57.475018 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:57.475283 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:57.477826 (+ 2543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:57.477830 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:57.477850 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:57.478483 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.478501 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.480759 (+ 2258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.480764 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.483709 (+ 2945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.483728 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.485521 (+ 1793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.485527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.485686 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.485720 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 23:03:57.485829 (+ 109us) client_negotiation.cc:240] Negotiation successful
0805 23:03:57.486082 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11498,"mutex_wait_us":209,"thread_start_us":12750,"threads_started":1}
I20260805 23:03:57.487083 10966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.464003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44224 (local address 127.22.45.67:46333)
0805 23:03:57.476803 (+ 12800us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.476811 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.476846 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:03:57.476946 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.476954 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.477250 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.477457 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:57.478754 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.480553 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.484177 (+ 3624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.485401 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.485507 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.485748 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.486538 (+ 790us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.486730 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12616,"thread_start_us":13393,"threads_started":1}
I20260805 23:03:57.487710 10967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.464171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.22.45.66:45757)
0805 23:03:57.474133 (+ 9962us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.474145 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.477015 (+ 2870us) server_negotiation.cc:407] Connection header received
0805 23:03:57.477127 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.477134 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.477715 (+ 581us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.477917 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:57.478885 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.480099 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.483345 (+ 3246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.484707 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.484867 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.485090 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.487093 (+ 2003us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.487368 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9781,"thread_start_us":9635,"threads_started":1}
I20260805 23:03:57.487756 10959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.463295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46333 (local address 127.0.0.1:44224)
0805 23:03:57.476165 (+ 12870us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:57.476186 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:57.476350 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:57.477773 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:57.477780 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:57.477813 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:57.478483 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.478501 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.480754 (+ 2253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.480759 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.483754 (+ 2995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.483765 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.485954 (+ 2189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.485962 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.486149 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.486182 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:03:57.486280 (+ 98us) client_negotiation.cc:240] Negotiation successful
0805 23:03:57.486410 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12737,"mutex_wait_us":95,"thread_start_us":13147,"threads_started":1}
I20260805 23:03:57.487957 10961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.463653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:45757 (local address 127.0.0.1:52520)
0805 23:03:57.476720 (+ 13067us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:57.476742 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:57.476871 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:57.478147 (+ 1276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:57.478151 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:57.478174 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:57.478681 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.478697 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.481090 (+ 2393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.481096 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.483159 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.483175 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.484960 (+ 1785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.484967 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.485176 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.485246 (+ 70us) client_negotiation.cc:769] Sending connection context
0805 23:03:57.487018 (+ 1772us) client_negotiation.cc:240] Negotiation successful
0805 23:03:57.487161 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12933,"mutex_wait_us":45,"thread_start_us":11885,"threads_started":1}
I20260805 23:03:57.491223 10500 tablet_service.cc:1467] Processing CreateTablet for tablet 084ec0e953f946ee882506e71ad84efa (DEFAULT_TABLE table=test-table [id=b033abf6299c491289f596ec16a2fc51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:57.491734 10679 tablet_service.cc:1467] Processing CreateTablet for tablet 084ec0e953f946ee882506e71ad84efa (DEFAULT_TABLE table=test-table [id=b033abf6299c491289f596ec16a2fc51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:57.491722 10856 tablet_service.cc:1467] Processing CreateTablet for tablet 084ec0e953f946ee882506e71ad84efa (DEFAULT_TABLE table=test-table [id=b033abf6299c491289f596ec16a2fc51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:03:57.492700 10500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084ec0e953f946ee882506e71ad84efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:57.493151 10856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084ec0e953f946ee882506e71ad84efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:57.493163 10679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 084ec0e953f946ee882506e71ad84efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:03:57.506582 10968 tablet_bootstrap.cc:492] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Bootstrap starting.
I20260805 23:03:57.509852 10969 tablet_bootstrap.cc:492] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Bootstrap starting.
I20260805 23:03:57.510748 10968 tablet_bootstrap.cc:654] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:57.512249 10968 log.cc:824] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:57.513710 10969 tablet_bootstrap.cc:654] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:57.513885 10970 tablet_bootstrap.cc:492] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Bootstrap starting.
I20260805 23:03:57.515125 10969 log.cc:824] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:57.517118 10968 tablet_bootstrap.cc:492] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: No bootstrap required, opened a new log
I20260805 23:03:57.517406 10968 ts_tablet_manager.cc:1397] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260805 23:03:57.517570 10970 tablet_bootstrap.cc:654] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Neither blocks nor log segments found. Creating new log.
I20260805 23:03:57.518616 10969 tablet_bootstrap.cc:492] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: No bootstrap required, opened a new log
I20260805 23:03:57.518904 10969 ts_tablet_manager.cc:1397] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260805 23:03:57.518992 10970 log.cc:824] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:57.524801 10970 tablet_bootstrap.cc:492] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: No bootstrap required, opened a new log
I20260805 23:03:57.525121 10970 ts_tablet_manager.cc:1397] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260805 23:03:57.526049 10968 raft_consensus.cc:348] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.526453 10968 raft_consensus.cc:374] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:57.526554 10968 raft_consensus.cc:729] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3147d711a0e4fe299b64baff9388885, State: Initialized, Role: FOLLOWER
I20260805 23:03:57.527211 10968 consensus_queue.cc:260] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.529285 10969 raft_consensus.cc:348] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.529769 10969 raft_consensus.cc:374] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:57.529874 10969 raft_consensus.cc:729] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f120da71835445d8868826b764b9108, State: Initialized, Role: FOLLOWER
I20260805 23:03:57.530536 10969 consensus_queue.cc:260] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.532516 10968 ts_tablet_manager.cc:1428] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260805 23:03:57.536444 10970 raft_consensus.cc:348] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.537060 10970 raft_consensus.cc:374] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:03:57.537168 10970 raft_consensus.cc:729] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c4a63fac3d342d28eff99df8905ed44, State: Initialized, Role: FOLLOWER
I20260805 23:03:57.537869 10946 heartbeater.cc:503] Master 127.22.45.126:39037 was elected leader, sending a full tablet report...
I20260805 23:03:57.539003 10969 ts_tablet_manager.cc:1428] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Time spent starting tablet: real 0.020s user 0.015s sys 0.004s
I20260805 23:03:57.539650 10970 consensus_queue.cc:260] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.541554 10970 ts_tablet_manager.cc:1428] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260805 23:03:57.541824 10769 heartbeater.cc:503] Master 127.22.45.126:39037 was elected leader, sending a full tablet report...
W20260805 23:03:57.639534 10770 tablet.cc:2369] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:03:57.645684 10947 tablet.cc:2369] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:03:57.657946 10595 tablet.cc:2369] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:03:57.783347 10975 raft_consensus.cc:482] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:03:57.783739 10975 raft_consensus.cc:504] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.785858 10975 leader_election.cc:288] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2f120da71835445d8868826b764b9108 (127.22.45.67:46333), 8c4a63fac3d342d28eff99df8905ed44 (127.22.45.66:45757)
I20260805 23:03:57.792644 10967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.786752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:39051 (local address 127.22.45.66:45757)
0805 23:03:57.787153 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.787159 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.787460 (+ 301us) server_negotiation.cc:407] Connection header received
0805 23:03:57.787634 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.787638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.787699 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.787774 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:57.788390 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.789088 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.790875 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.791692 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.791840 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.791919 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.792251 (+ 332us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.792386 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251}
I20260805 23:03:57.792691 10966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.786218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:44539 (local address 127.22.45.67:46333)
0805 23:03:57.786456 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.786461 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.787280 (+ 819us) server_negotiation.cc:407] Connection header received
0805 23:03:57.787483 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.787487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.787552 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.787630 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:03:57.788262 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.789002 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.790840 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.791691 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.791848 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.791924 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.792299 (+ 375us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.792429 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260805 23:03:57.792800 10981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.786337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:45757 (local address 127.22.45.65:39051)
0805 23:03:57.787346 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:57.787361 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:57.787503 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:57.787826 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:57.787834 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:57.787886 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:57.788225 (+ 339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.788234 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.789236 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.789240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.790717 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.790730 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.791930 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.791936 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.792077 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.792122 (+ 45us) client_negotiation.cc:769] Sending connection context
0805 23:03:57.792202 (+ 80us) client_negotiation.cc:240] Negotiation successful
0805 23:03:57.792341 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":902,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":697,"threads_started":1}
I20260805 23:03:57.793174 10980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.786310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46333 (local address 127.22.45.65:44539)
0805 23:03:57.787141 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:57.787175 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0805 23:03:57.787341 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:03:57.787664 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:03:57.787668 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:03:57.787694 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:03:57.788099 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.788113 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.789136 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.789141 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.790671 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:03:57.790688 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.791973 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.791978 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:03:57.792137 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.792167 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 23:03:57.792245 (+ 78us) client_negotiation.cc:240] Negotiation successful
0805 23:03:57.792374 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":684,"mutex_wait_us":22,"spinlock_wait_cycles":17152,"thread_start_us":442,"threads_started":1}
I20260805 23:03:57.793884 10710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084ec0e953f946ee882506e71ad84efa" candidate_uuid: "f3147d711a0e4fe299b64baff9388885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c4a63fac3d342d28eff99df8905ed44" is_pre_election: true
I20260805 23:03:57.794092 10885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084ec0e953f946ee882506e71ad84efa" candidate_uuid: "f3147d711a0e4fe299b64baff9388885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f120da71835445d8868826b764b9108" is_pre_election: true
I20260805 23:03:57.794407 10710 raft_consensus.cc:2454] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3147d711a0e4fe299b64baff9388885 in term 0.
I20260805 23:03:57.794567 10885 raft_consensus.cc:2454] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3147d711a0e4fe299b64baff9388885 in term 0.
I20260805 23:03:57.795109 10435 leader_election.cc:302] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8c4a63fac3d342d28eff99df8905ed44, f3147d711a0e4fe299b64baff9388885; no voters:
I20260805 23:03:57.795538 10975 raft_consensus.cc:2781] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:03:57.795679 10975 raft_consensus.cc:482] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:03:57.795776 10975 raft_consensus.cc:3037] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:57.798058 10975 raft_consensus.cc:504] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.798760 10975 leader_election.cc:288] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [CANDIDATE]: Term 1 election: Requested vote from peers 2f120da71835445d8868826b764b9108 (127.22.45.67:46333), 8c4a63fac3d342d28eff99df8905ed44 (127.22.45.66:45757)
I20260805 23:03:57.799294 10885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084ec0e953f946ee882506e71ad84efa" candidate_uuid: "f3147d711a0e4fe299b64baff9388885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2f120da71835445d8868826b764b9108"
I20260805 23:03:57.799353 10710 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "084ec0e953f946ee882506e71ad84efa" candidate_uuid: "f3147d711a0e4fe299b64baff9388885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c4a63fac3d342d28eff99df8905ed44"
I20260805 23:03:57.799502 10885 raft_consensus.cc:3037] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:57.799566 10710 raft_consensus.cc:3037] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:03:57.802063 10710 raft_consensus.cc:2454] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3147d711a0e4fe299b64baff9388885 in term 1.
I20260805 23:03:57.802063 10885 raft_consensus.cc:2454] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3147d711a0e4fe299b64baff9388885 in term 1.
I20260805 23:03:57.802619 10437 leader_election.cc:302] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2f120da71835445d8868826b764b9108, f3147d711a0e4fe299b64baff9388885; no voters:
I20260805 23:03:57.802986 10975 raft_consensus.cc:2781] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:03:57.803453 10975 raft_consensus.cc:686] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 1 LEADER]: Becoming Leader. State: Replica: f3147d711a0e4fe299b64baff9388885, State: Running, Role: LEADER
I20260805 23:03:57.804004 10975 consensus_queue.cc:237] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } }
I20260805 23:03:57.808706 10340 catalog_manager.cc:5495] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3147d711a0e4fe299b64baff9388885 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "f3147d711a0e4fe299b64baff9388885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f3147d711a0e4fe299b64baff9388885" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 32977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 } health_report { overall_health: UNKNOWN } } }
I20260805 23:03:57.869803 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.864533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59610 (local address 127.22.45.65:32977)
0805 23:03:57.864722 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.864726 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.864744 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:03:57.864884 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.864888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.864973 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.865108 (+ 135us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:03:57.865408 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.866155 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.867647 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.868088 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.868203 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.868742 (+ 539us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:03:57.869318 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:03:57.869435 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:57.869509 (+ 74us) server_negotiation.cc:299] Negotiation successful
0805 23:03:57.869589 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260805 23:03:57.879088 10885 raft_consensus.cc:1261] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Refusing update from remote peer f3147d711a0e4fe299b64baff9388885: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:57.879088 10710 raft_consensus.cc:1261] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 1 FOLLOWER]: Refusing update from remote peer f3147d711a0e4fe299b64baff9388885: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:03:57.880342 10975 consensus_queue.cc:1035] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c4a63fac3d342d28eff99df8905ed44" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 45757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:57.880687 10982 consensus_queue.cc:1035] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2f120da71835445d8868826b764b9108" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:03:57.907965 10986 mvcc.cc:205] Tried to move back new op lower bound from 7315337371140591616 to 7315337370848985088. Current Snapshot: MvccSnapshot[applied={T|T < 7315337371140591616}]
I20260805 23:03:57.908540 10988 mvcc.cc:205] Tried to move back new op lower bound from 7315337371140591616 to 7315337370848985088. Current Snapshot: MvccSnapshot[applied={T|T < 7315337371140591616}]
I20260805 23:03:57.911095 10987 mvcc.cc:205] Tried to move back new op lower bound from 7315337371140591616 to 7315337370848985088. Current Snapshot: MvccSnapshot[applied={T|T < 7315337371140591616}]
I20260805 23:03:57.926291 10342 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:50972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:03:57.926595 10342 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:50972:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:03:57.930678 10342 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Sending DeleteTablet for 3 replicas of tablet 084ec0e953f946ee882506e71ad84efa
I20260805 23:03:57.932116 10856 tablet_service.cc:1514] Processing DeleteTablet for tablet 084ec0e953f946ee882506e71ad84efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:57 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:44224
I20260805 23:03:57.932281 10500 tablet_service.cc:1514] Processing DeleteTablet for tablet 084ec0e953f946ee882506e71ad84efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:57 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:59602
I20260805 23:03:57.932547 10679 tablet_service.cc:1514] Processing DeleteTablet for tablet 084ec0e953f946ee882506e71ad84efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:03:57 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:52520
I20260805 23:03:57.933729 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 10388
I20260805 23:03:57.961591 11000 tablet_replica.cc:330] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: stopping tablet replica
I20260805 23:03:57.962244 11000 raft_consensus.cc:2229] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:03:57.963157 11000 raft_consensus.cc:2258] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:57.968238 11001 tablet_replica.cc:330] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: stopping tablet replica
I20260805 23:03:57.968875 11001 raft_consensus.cc:2229] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:03:57.968890 11000 ts_tablet_manager.cc:1905] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:57.969508 11001 raft_consensus.cc:2258] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:57.980026 10999 tablet_replica.cc:330] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: stopping tablet replica
I20260805 23:03:57.980512 10999 raft_consensus.cc:2229] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:03:57.980455 11000 ts_tablet_manager.cc:1918] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:57.980702 11000 log.cc:1196] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/084ec0e953f946ee882506e71ad84efa
I20260805 23:03:57.981046 10999 raft_consensus.cc:2258] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:03:57.981424 11000 ts_tablet_manager.cc:1939] T 084ec0e953f946ee882506e71ad84efa P f3147d711a0e4fe299b64baff9388885: Deleting consensus metadata
I20260805 23:03:57.982178 11001 ts_tablet_manager.cc:1905] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:57.983844 10325 catalog_manager.cc:4841] TS f3147d711a0e4fe299b64baff9388885 (127.22.45.65:32977): tablet 084ec0e953f946ee882506e71ad84efa (table test-table [id=b033abf6299c491289f596ec16a2fc51]) successfully deleted
I20260805 23:03:57.985057 10999 ts_tablet_manager.cc:1905] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:03:57.989416 11001 ts_tablet_manager.cc:1918] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:57.989666 11001 log.cc:1196] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/084ec0e953f946ee882506e71ad84efa
I20260805 23:03:57.990273 11001 ts_tablet_manager.cc:1939] T 084ec0e953f946ee882506e71ad84efa P 8c4a63fac3d342d28eff99df8905ed44: Deleting consensus metadata
I20260805 23:03:57.992910 10999 ts_tablet_manager.cc:1918] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:03:57.993157 10999 log.cc:1196] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/084ec0e953f946ee882506e71ad84efa
I20260805 23:03:57.993772 10999 ts_tablet_manager.cc:1939] T 084ec0e953f946ee882506e71ad84efa P 2f120da71835445d8868826b764b9108: Deleting consensus metadata
I20260805 23:03:57.996589 10326 catalog_manager.cc:4841] TS 2f120da71835445d8868826b764b9108 (127.22.45.67:46333): tablet 084ec0e953f946ee882506e71ad84efa (table test-table [id=b033abf6299c491289f596ec16a2fc51]) successfully deleted
I20260805 23:03:57.998908 10322 catalog_manager.cc:4841] TS 8c4a63fac3d342d28eff99df8905ed44 (127.22.45.66:45757): tablet 084ec0e953f946ee882506e71ad84efa (table test-table [id=b033abf6299c491289f596ec16a2fc51]) successfully deleted
I20260805 23:03:58.004140 10963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:57.935169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.22.45.65:32977)
0805 23:03:57.935400 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:57.935408 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:57.957704 (+ 22296us) server_negotiation.cc:407] Connection header received
0805 23:03:57.958319 (+ 615us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:57.958327 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:57.958454 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:57.958540 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:57.963725 (+ 5185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.965084 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.970059 (+ 4975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:57.971021 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:57.971169 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:57.996147 (+ 24978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:57.996170 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:57.996192 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:57.996256 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:58.000705 (+ 4449us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:58.001704 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:58.001716 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:58.001720 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:58.001955 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:58.002490 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:58.002493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:58.002495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:58.002953 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:58.003244 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:58.003609 (+ 365us) server_negotiation.cc:299] Negotiation successful
0805 23:03:58.003834 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 23:03:58.004889 10589 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:58.108614 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 10388
I20260805 23:03:58.132530 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 10599
I20260805 23:03:58.147148 10967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:58.133310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.22.45.66:45757)
0805 23:03:58.133509 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:58.133514 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:58.133534 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:03:58.133707 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:58.133711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:58.133795 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:58.133899 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:58.135430 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:58.136175 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:58.137480 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:58.137864 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:58.137955 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:58.141006 (+ 3051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:58.141028 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:58.141046 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:58.141089 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:58.144037 (+ 2948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:58.144955 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:58.144965 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:58.144967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:58.145148 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:58.145500 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:58.145503 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:58.145505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:58.145951 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:58.146191 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:58.146528 (+ 337us) server_negotiation.cc:299] Negotiation successful
0805 23:03:58.146734 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 23:03:58.147972 10763 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:58.241391 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 10599
I20260805 23:03:58.263883 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 10772
I20260805 23:03:58.278393 10966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:58.264784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44232 (local address 127.22.45.67:46333)
0805 23:03:58.264983 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 23:03:58.264989 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:03:58.265012 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:03:58.265082 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:03:58.265088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:03:58.265183 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:03:58.265280 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:03:58.266716 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:58.267571 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:58.269037 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:03:58.269450 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:03:58.269571 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:03:58.272374 (+ 2803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:03:58.272392 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:03:58.272411 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:03:58.272452 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:03:58.275271 (+ 2819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:58.276101 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:58.276110 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:58.276112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:58.276277 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:03:58.276673 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:03:58.276678 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:03:58.276680 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:03:58.277096 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:03:58.277422 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0805 23:03:58.277798 (+ 376us) server_negotiation.cc:299] Negotiation successful
0805 23:03:58.278043 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:03:58.279237 10940 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:58.370064 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 10772
I20260805 23:03:58.390494 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 10292
I20260805 23:03:58.391746 10378 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:03:58.508013 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 10292
I20260805 23:03:58.535207 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39037
--webserver_interface=127.22.45.126
--webserver_port=41273
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:39037
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:03:58.899793 11008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:58.900163 11008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:58.900286 11008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:58.907977 11008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:03:58.908131 11008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:58.908183 11008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:58.908265 11008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:03:58.908329 11008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:03:58.919147 11008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:39037
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:39037
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=41273
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:58.920714 11008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:58.922196 11008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:58.935494 11017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:58.935604 11014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:58.935573 11015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:58.937266 11008 server_base.cc:1034] running on GCE node
I20260805 23:03:58.938191 11008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:58.939896 11008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:58.941128 11008 hybrid_clock.cc:648] HybridClock initialized: now 1785971038941070 us; error 50 us; skew 500 ppm
I20260805 23:03:58.941507 11008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:58 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971038, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:58.947839 11008 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:03:58.949687 11008 webserver.cc:460] Webserver started at http://127.22.45.126:41273/ using document root <none> and password file <none>
I20260805 23:03:58.950479 11008 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:58.950610 11008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:58.957134 11008 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260805 23:03:58.962616 11028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:58.964324 11008 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260805 23:03:58.964531 11008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "4252792d64c14f18b3c2e7265a734141"
format_stamp: "Formatted at 2026-08-05 23:03:52 on dist-test-slave-1vmg"
server_key: "ac3f8b2724cf86c88b62c2297d6c68f6"
server_key_iv: "d4dd9ae577fc99874ea8539d3ade6b7e"
server_key_version: "encryptionkey@0"
I20260805 23:03:58.965639 11008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:59.006814 11008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:59.011560 11008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:59.011862 11008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:59.031766 11008 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:39037
I20260805 23:03:59.031785 11093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:39037 every 8 connection(s)
I20260805 23:03:59.033519 11008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:03:59.035869 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 11008
I20260805 23:03:59.036753 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:32977
--local_ip_for_outbound_sockets=127.22.45.65
--tserver_master_addrs=127.22.45.126:39037
--webserver_port=39793
--webserver_interface=127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:03:59.041577 11094 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:03:59.045490 11094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Bootstrap starting.
I20260805 23:03:59.075143 11094 log.cc:824] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Log is configured to *not* fsync() on all Append() calls
I20260805 23:03:59.097165 11094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:03:59.097828 11094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141: Bootstrap complete.
I20260805 23:03:59.107645 11094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:59.108726 11094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4252792d64c14f18b3c2e7265a734141, State: Initialized, Role: FOLLOWER
I20260805 23:03:59.109478 11094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:59.109725 11094 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:03:59.110473 11094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:03:59.110699 11094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 2 FOLLOWER]: Advancing to term 3
I20260805 23:03:59.115315 11094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:59.116405 11094 leader_election.cc:302] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4252792d64c14f18b3c2e7265a734141; no voters:
I20260805 23:03:59.117262 11094 leader_election.cc:288] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 23:03:59.117468 11100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 23:03:59.120177 11094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:03:59.124914 11100 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [term 3 LEADER]: Becoming Leader. State: Replica: 4252792d64c14f18b3c2e7265a734141, State: Running, Role: LEADER
I20260805 23:03:59.125792 11100 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } }
I20260805 23:03:59.128919 11102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "4252792d64c14f18b3c2e7265a734141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } } }
I20260805 23:03:59.129427 11102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:59.129921 11103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4252792d64c14f18b3c2e7265a734141. Latest consensus state: current_term: 3 leader_uuid: "4252792d64c14f18b3c2e7265a734141" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4252792d64c14f18b3c2e7265a734141" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 39037 } } }
I20260805 23:03:59.130309 11103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4252792d64c14f18b3c2e7265a734141 [sys.catalog]: This master's current role is: LEADER
I20260805 23:03:59.132863 11109 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:03:59.143517 11109 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:03:59.145274 11109 catalog_manager.cc:1259] Loaded cluster ID: 319ee6f4f2e443cfaf2818d5ae6bacb1
I20260805 23:03:59.145409 11109 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260805 23:03:59.147854 11109 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fec5818e9ad google::LogMessage::Fail() at ??:0
@ 0x7fec5819188a google::LogMessage::SendToLog() at ??:0
@ 0x7fec5818e4de google::LogMessage::Flush() at ??:0
@ 0x7fec5818fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fec6dbc1512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fec6dbbe976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fec6dc46610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fec6dc46439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fec5adda345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fec5addd91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fec5addd799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fec5adb8eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fec5e0926db start_thread at ??:0
@ 0x7fec5702861f clone at ??:0
W20260805 23:03:59.482523 11096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:59.482862 11096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:59.483016 11096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:59.490737 11096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:59.490901 11096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:59.491092 11096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:03:59.501680 11096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:32977
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=39793
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:03:59.503211 11096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:03:59.504680 11096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:03:59.519207 11153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:59.519166 11158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:03:59.519130 11154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:03:59.520294 11096 server_base.cc:1034] running on GCE node
I20260805 23:03:59.521013 11096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:03:59.522071 11096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:03:59.523285 11096 hybrid_clock.cc:648] HybridClock initialized: now 1785971039523228 us; error 52 us; skew 500 ppm
I20260805 23:03:59.523617 11096 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:03:59 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971039, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:03:59.527295 11096 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:03:59.529007 11096 webserver.cc:460] Webserver started at http://127.22.45.65:39793/ using document root <none> and password file <none>
I20260805 23:03:59.529820 11096 fs_manager.cc:359] Metadata directory not provided
I20260805 23:03:59.529959 11096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:03:59.536573 11096 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:03:59.540035 11169 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:59.541656 11096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:03:59.541849 11096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "f3147d711a0e4fe299b64baff9388885"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "2109364eba38bb6ca77769fb38e11741"
server_key_iv: "f36c5986cecf67fedbe4af8b1c708427"
server_key_version: "encryptionkey@0"
I20260805 23:03:59.543033 11096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:03:59.564538 11096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:03:59.568789 11096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:03:59.569067 11096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:03:59.570134 11096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:03:59.571604 11096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:03:59.571704 11096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:59.571820 11096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:03:59.571902 11096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:03:59.606629 11096 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:32977
I20260805 23:03:59.606709 11317 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:32977 every 8 connection(s)
I20260805 23:03:59.608213 11096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:03:59.613198 11320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:59.611249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:53537)
0805 23:03:59.612008 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:59.612273 (+ 265us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":288,"threads_started":1}
I20260805 23:03:59.613867 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 11096
W20260805 23:03:59.614611 11318 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:39037 (0 consecutive failures): Network error: Failed to ping master at 127.22.45.126:39037: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
I20260805 23:03:59.614651 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:45757
--local_ip_for_outbound_sockets=127.22.45.66
--tserver_master_addrs=127.22.45.126:39037
--webserver_port=46363
--webserver_interface=127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:03:59.615634 11320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:59.615265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:33891)
0805 23:03:59.615425 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:59.615502 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260805 23:03:59.616659 11320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:03:59.616303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:56439)
0805 23:03:59.616443 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0805 23:03:59.616528 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260805 23:03:59.616961 11318 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 23:03:59.980259 11321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:03:59.980600 11321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:03:59.980701 11321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:03:59.988366 11321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:03:59.988516 11321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:03:59.988644 11321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:03:59.999060 11321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:45757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=46363
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:00.000507 11321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:00.001883 11321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:00.015348 11329 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:00.015400 11330 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:00.015357 11334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:00.015961 11321 server_base.cc:1034] running on GCE node
I20260805 23:04:00.016736 11321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:00.017769 11321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:00.019003 11321 hybrid_clock.cc:648] HybridClock initialized: now 1785971040018955 us; error 40 us; skew 500 ppm
I20260805 23:04:00.019335 11321 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:00 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971040, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:00.022634 11321 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:04:00.024276 11321 webserver.cc:460] Webserver started at http://127.22.45.66:46363/ using document root <none> and password file <none>
I20260805 23:04:00.025005 11321 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:00.025141 11321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:00.031013 11321 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:04:00.033942 11342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:00.035378 11321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:04:00.035539 11321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "8c4a63fac3d342d28eff99df8905ed44"
format_stamp: "Formatted at 2026-08-05 23:03:53 on dist-test-slave-1vmg"
server_key: "620dcf828d2020fba5b2e086a34d2795"
server_key_iv: "f8cee0f39418f4d9a586dae14b022fca"
server_key_version: "encryptionkey@0"
I20260805 23:04:00.036564 11321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:00.055095 11321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:00.059835 11321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:00.060132 11321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:00.061242 11321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:00.062785 11321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:00.062887 11321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:00.063025 11321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:00.063100 11321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:00.097252 11321 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:45757
I20260805 23:04:00.097314 11482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:45757 every 8 connection(s)
I20260805 23:04:00.098904 11321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:04:00.104451 11485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:00.102310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:57207)
0805 23:04:00.103211 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:00.103469 (+ 258us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":336,"threads_started":1}
W20260805 23:04:00.105268 11483 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:39037 (0 consecutive failures): Network error: Failed to ping master at 127.22.45.126:39037: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
I20260805 23:04:00.106107 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 11321
I20260805 23:04:00.106333 11485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:00.105943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:55473)
0805 23:04:00.106111 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:00.106199 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260805 23:04:00.106961 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:46333
--local_ip_for_outbound_sockets=127.22.45.67
--tserver_master_addrs=127.22.45.126:39037
--webserver_port=38297
--webserver_interface=127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:04:00.107430 11485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:00.107016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:43585)
0805 23:04:00.107209 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:00.107306 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260805 23:04:00.107672 11483 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 23:04:00.457051 11487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:00.457388 11487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:00.457515 11487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:00.465276 11487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:00.465410 11487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:00.465570 11487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:04:00.476061 11487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:46333
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=38297
--tserver_master_addrs=127.22.45.126:39037
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:00.477515 11487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:00.478994 11487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:00.493218 11496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:00.493261 11504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:00.493286 11497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:00.494772 11487 server_base.cc:1034] running on GCE node
I20260805 23:04:00.495594 11487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:00.496760 11487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:00.498024 11487 hybrid_clock.cc:648] HybridClock initialized: now 1785971040497967 us; error 60 us; skew 500 ppm
I20260805 23:04:00.498412 11487 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:00 dist-test-slave-1vmg krb5kdc[9561](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971040, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:00.502718 11487 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:04:00.504447 11487 webserver.cc:460] Webserver started at http://127.22.45.67:38297/ using document root <none> and password file <none>
I20260805 23:04:00.505229 11487 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:00.505370 11487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:00.511421 11487 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260805 23:04:00.514569 11513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:00.516289 11487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:04:00.516475 11487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "2f120da71835445d8868826b764b9108"
format_stamp: "Formatted at 2026-08-05 23:03:54 on dist-test-slave-1vmg"
server_key: "6aa1023cd0d5bc3cb6c68058054b8733"
server_key_iv: "4c9b2e20002ee6599726e1c419b955b7"
server_key_version: "encryptionkey@0"
I20260805 23:04:00.517640 11487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:00.542480 11487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:00.547518 11487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:00.547814 11487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:00.548974 11487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:00.550561 11487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:00.550678 11487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:00.550796 11487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:00.550875 11487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:00.583755 11487 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46333
I20260805 23:04:00.583829 11655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46333 every 8 connection(s)
I20260805 23:04:00.585289 11487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:04:00.587743 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 11487
I20260805 23:04:00.590682 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:00.588522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:38233)
0805 23:04:00.589431 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:00.589685 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":365,"threads_started":1}
W20260805 23:04:00.591549 11656 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:39037 (0 consecutive failures): Network error: Failed to ping master at 127.22.45.126:39037: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
I20260805 23:04:00.592499 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:00.592159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:42661)
0805 23:04:00.592307 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:00.592380 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260805 23:04:00.593366 11659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:00.593030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:58945)
0805 23:04:00.593173 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:00.593252 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260805 23:04:00.593602 11656 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 23:04:00.618461 11660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:00.617603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:55455)
0805 23:04:00.618098 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:00.618209 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":234,"threads_started":1}
I20260805 23:04:01.109366 11661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:01.108366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:41729)
0805 23:04:01.108943 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:01.109100 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":281,"threads_started":1}
I20260805 23:04:01.595489 11662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:01.594351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:59995)
0805 23:04:01.595063 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:01.595177 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":376,"threads_started":1}
I20260805 23:04:01.620319 11664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:01.619495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:37023)
0805 23:04:01.620034 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:01.620134 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":295,"threads_started":1}
I20260805 23:04:02.111352 11665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:02.110473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:35493)
0805 23:04:02.111066 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:02.111165 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":277,"threads_started":1}
I20260805 23:04:02.597579 11666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:02.596672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:49645)
0805 23:04:02.597228 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:02.597351 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":251,"threads_started":1}
I20260805 23:04:02.622099 11667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:02.621247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:58587)
0805 23:04:02.621782 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:02.621894 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":286,"threads_started":1}
I20260805 23:04:03.113121 11668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:03.112377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:41067)
0805 23:04:03.112843 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:03.112935 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":245,"threads_started":1}
I20260805 23:04:03.599536 11669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:03.598682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:48243)
0805 23:04:03.599237 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:03.599334 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":289,"threads_started":1}
I20260805 23:04:03.624032 11670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:03.623226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:37221)
0805 23:04:03.623734 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:03.623837 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":249,"threads_started":1}
I20260805 23:04:04.115057 11671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:04.114171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:42955)
0805 23:04:04.114674 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:04.114803 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":241,"threads_started":1}
I20260805 23:04:04.601425 11672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:04.600600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:42143)
0805 23:04:04.601117 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:04.601227 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":247,"threads_started":1}
I20260805 23:04:04.625957 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:04.625129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:44483)
0805 23:04:04.625666 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:04.625767 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":274,"threads_started":1}
I20260805 23:04:05.117117 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:05.116214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:55945)
0805 23:04:05.116829 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:05.116930 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":301,"threads_started":1}
I20260805 23:04:05.603412 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:05.602572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:45797)
0805 23:04:05.603139 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:05.603234 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":270,"threads_started":1}
I20260805 23:04:05.627983 11677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:05.627155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:37543)
0805 23:04:05.627692 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:05.627802 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":270,"threads_started":1}
I20260805 23:04:06.119246 11678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:06.118238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:40311)
0805 23:04:06.118887 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:06.119055 (+ 168us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":345,"threads_started":1}
I20260805 23:04:06.605299 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:06.604462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:58293)
0805 23:04:06.604998 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:06.605123 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":268,"threads_started":1}
I20260805 23:04:06.630025 11680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:06.629147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:43817)
0805 23:04:06.629700 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:06.629802 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":246,"threads_started":1}
I20260805 23:04:07.121337 11681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:07.120380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:48977)
0805 23:04:07.120972 (+ 592us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:07.121075 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":269,"threads_started":1}
I20260805 23:04:07.607196 11682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:07.606276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:38729)
0805 23:04:07.606840 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:07.606982 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":269,"threads_started":1}
I20260805 23:04:07.631870 11683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:07.631091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:52615)
0805 23:04:07.631591 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:07.631697 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":275,"threads_started":1}
I20260805 23:04:08.123431 11684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:08.122529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:36391)
0805 23:04:08.123138 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:08.123248 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":266,"threads_started":1}
I20260805 23:04:08.609100 11685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:08.608300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:49395)
0805 23:04:08.608842 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:08.608936 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":286,"threads_started":1}
I20260805 23:04:08.633734 11686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:08.632863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:58447)
0805 23:04:08.633429 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:08.633530 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":306,"threads_started":1}
I20260805 23:04:09.125438 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:09.124549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:60659)
0805 23:04:09.125155 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:09.125252 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":310,"threads_started":1}
I20260805 23:04:09.610984 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:09.610137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:48933)
0805 23:04:09.610678 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:09.610769 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":261,"threads_started":1}
I20260805 23:04:09.635722 11689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:09.634876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:44111)
0805 23:04:09.635431 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:09.635533 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":291,"threads_started":1}
I20260805 23:04:10.127538 11690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:10.126600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:41049)
0805 23:04:10.127235 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:10.127342 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":379,"threads_started":1}
I20260805 23:04:10.612901 11691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:10.612048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:49127)
0805 23:04:10.612571 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:10.612684 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":296,"threads_started":1}
I20260805 23:04:10.637458 11692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:10.636662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:48189)
0805 23:04:10.637145 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:10.637262 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":251,"threads_started":1}
I20260805 23:04:11.129928 11693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:11.128664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:52137)
0805 23:04:11.129600 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:11.129728 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":803,"thread_start_us":706,"threads_started":1}
I20260805 23:04:11.615070 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:11.614062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:53035)
0805 23:04:11.614715 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:11.614821 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":310,"threads_started":1}
I20260805 23:04:11.639279 11696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:11.638445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:54175)
0805 23:04:11.639005 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:11.639104 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":271,"threads_started":1}
I20260805 23:04:12.132280 11697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:12.131181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:45155)
0805 23:04:12.131923 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:12.132064 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":339,"threads_started":1}
I20260805 23:04:12.617084 11698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:12.616212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:52525)
0805 23:04:12.616767 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:12.616890 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":272,"threads_started":1}
I20260805 23:04:12.641281 11702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:12.640351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:50163)
0805 23:04:12.640966 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:12.641078 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":291,"threads_started":1}
I20260805 23:04:13.134402 11703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:13.133561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:35203)
0805 23:04:13.134088 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:13.134190 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":256,"threads_started":1}
I20260805 23:04:13.619256 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:13.618339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:46281)
0805 23:04:13.618900 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:13.619040 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":286,"threads_started":1}
I20260805 23:04:13.643169 11705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:13.642308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:49833)
0805 23:04:13.642803 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:13.642907 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":238,"threads_started":1}
I20260805 23:04:14.136384 11706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:14.135566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:40081)
0805 23:04:14.136080 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:14.136180 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":265,"threads_started":1}
I20260805 23:04:14.621205 11707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:14.620292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:45593)
0805 23:04:14.620895 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:14.621006 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":325,"threads_started":1}
I20260805 23:04:14.645287 11708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:14.644445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:53625)
0805 23:04:14.644960 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:14.645094 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":272,"threads_started":1}
I20260805 23:04:15.138626 11709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:15.137735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.66:34987)
0805 23:04:15.138311 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:15.138420 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":306,"threads_started":1}
I20260805 23:04:15.589520 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 11096
I20260805 23:04:15.609944 11710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:15.590952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53128 (local address 127.22.45.65:32977)
0805 23:04:15.591610 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:15.591631 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:15.591700 (+ 69us) server_negotiation.cc:407] Connection header received
0805 23:04:15.593718 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:15.593731 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:15.594236 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:15.594641 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:15.596393 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:15.597698 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:15.599068 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:15.599862 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:15.600063 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:15.603043 (+ 2980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:15.603055 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:15.603076 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:15.603127 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:15.606207 (+ 3080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:15.607049 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:15.607057 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:15.607065 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:15.607268 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:15.607681 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:15.607685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:15.607687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:15.608294 (+ 607us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:15.608675 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:15.609100 (+ 425us) server_negotiation.cc:299] Negotiation successful
0805 23:04:15.609613 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":299,"threads_started":1}
I20260805 23:04:15.611580 11313 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:15.623358 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:15.622473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.67:41287)
0805 23:04:15.623037 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:15.623164 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":281,"threads_started":1}
I20260805 23:04:15.700764 11713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:15.699378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:39037 (local address 127.22.45.65:32813)
0805 23:04:15.700167 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:15.700376 (+ 209us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:39037: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":646,"thread_start_us":488,"threads_started":1}
I20260805 23:04:15.701800 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 11096
I20260805 23:04:15.724382 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 11321
I20260805 23:04:15.743206 11714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:15.725413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55848 (local address 127.22.45.66:45757)
0805 23:04:15.725943 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:15.725960 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:15.726002 (+ 42us) server_negotiation.cc:407] Connection header received
0805 23:04:15.727687 (+ 1685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:15.727701 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:15.728217 (+ 516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:15.728554 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:15.730075 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:15.731483 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:15.732752 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:15.733516 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:15.733679 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:15.736604 (+ 2925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:15.736615 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:15.736633 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:15.736678 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:15.739647 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:15.740429 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:15.740437 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:15.740445 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:15.740665 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:15.741050 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:15.741053 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:15.741055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:15.741693 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:15.741971 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:15.742329 (+ 358us) server_negotiation.cc:299] Negotiation successful
0805 23:04:15.742784 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":221,"threads_started":1}
I20260805 23:04:15.744769 11477 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:15.831913 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 11321
I20260805 23:04:15.855314 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 11487
I20260805 23:04:15.874722 11716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:15.856482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43240 (local address 127.22.45.67:46333)
0805 23:04:15.857120 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:15.857136 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:15.857183 (+ 47us) server_negotiation.cc:407] Connection header received
0805 23:04:15.858887 (+ 1704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:15.858899 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:15.859447 (+ 548us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:15.859814 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:15.861284 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:15.862650 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:15.864267 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:15.865058 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:15.865226 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:15.868252 (+ 3026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:15.868262 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:15.868281 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:15.868333 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:15.871505 (+ 3172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:15.872331 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:15.872340 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:15.872348 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:15.872537 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:15.872856 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:15.872859 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:15.872861 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:15.873441 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:15.873720 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:15.874033 (+ 313us) server_negotiation.cc:299] Negotiation successful
0805 23:04:15.874393 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":304,"threads_started":1}
I20260805 23:04:15.876207 11648 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:15.961787 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 11487
2026-08-05T23:04:15Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25490 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:04:16 dist-test-slave-1vmg krb5kdc[11720](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:04:16 dist-test-slave-1vmg krb5kdc[11720](info): set up 2 sockets
Aug 05 23:04:16 dist-test-slave-1vmg krb5kdc[11720](info): commencing operation
krb5kdc: starting...
W20260805 23:04:17.162559 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.153s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:04:17 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:04:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:04:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:04:17.468370 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35221
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:35221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:04:17.829856 11736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:17.830227 11736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:17.830371 11736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:17.838003 11736 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 23:04:17.838150 11736 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 23:04:17.838215 11736 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 23:04:17.838287 11736 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:04:17.838361 11736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:17.838462 11736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:17.838523 11736 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:04:17.838603 11736 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:04:17.849159 11736 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:35221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:17.850576 11736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:17.852058 11736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:17.864400 11744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:17.864389 11745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:17.864336 11747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:17.865155 11736 server_base.cc:1034] running on GCE node
I20260805 23:04:17.865980 11736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:17.867481 11736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:17.868717 11736 hybrid_clock.cc:648] HybridClock initialized: now 1785971057868648 us; error 43 us; skew 500 ppm
I20260805 23:04:17.869057 11736 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260805 23:04:18.871572 11736 net_util.cc:504] Time spent look up canonical hostname for localhost 'dist-test-slave-1vmg': real 1.002s user 0.001s sys 0.000s
Aug 05 23:04:18 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971058, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:18.874385 11736 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:04:18.876423 11736 webserver.cc:460] Webserver started at http://127.22.45.126:39129/ using document root <none> and password file <none>
I20260805 23:04:18.877257 11736 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:18.877404 11736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:18.877750 11736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:04:18.881237 11736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "92dc9f8901c1440ebede1ccfed7fc964"
format_stamp: "Formatted at 2026-08-05 23:04:18 on dist-test-slave-1vmg"
server_key: "40fbcf7833c4c4a46261d6b36062ac03"
server_key_iv: "099079d804df5610a7883db064a76b8d"
server_key_version: "encryptionkey@0"
I20260805 23:04:18.882158 11736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "92dc9f8901c1440ebede1ccfed7fc964"
format_stamp: "Formatted at 2026-08-05 23:04:18 on dist-test-slave-1vmg"
server_key: "40fbcf7833c4c4a46261d6b36062ac03"
server_key_iv: "099079d804df5610a7883db064a76b8d"
server_key_version: "encryptionkey@0"
I20260805 23:04:18.888398 11736 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:04:18.892446 11757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:18.894164 11736 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:04:18.894375 11736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "92dc9f8901c1440ebede1ccfed7fc964"
format_stamp: "Formatted at 2026-08-05 23:04:18 on dist-test-slave-1vmg"
server_key: "40fbcf7833c4c4a46261d6b36062ac03"
server_key_iv: "099079d804df5610a7883db064a76b8d"
server_key_version: "encryptionkey@0"
I20260805 23:04:18.894613 11736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:18.907809 11736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:18.912488 11736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:18.912825 11736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:18.933213 11736 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:35221
I20260805 23:04:18.933219 11825 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:35221 every 8 connection(s)
I20260805 23:04:18.934877 11736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:04:18.935974 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 11736
I20260805 23:04:18.936208 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:04:18.936839 22709 external_mini_cluster.cc:1428] Setting key 6ad1e55219eeee8e484bfc994a488629
I20260805 23:04:18.939640 11826 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:04:18 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:04:18.953824 11826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Bootstrap starting.
I20260805 23:04:18.958513 11826 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Neither blocks nor log segments found. Creating new log.
I20260805 23:04:18.959975 11826 log.cc:824] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:18.963935 11830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:18.938960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57436 (local address 127.22.45.126:35221)
0805 23:04:18.939808 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:18.939824 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:18.939879 (+ 55us) server_negotiation.cc:407] Connection header received
0805 23:04:18.942172 (+ 2293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:18.942203 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:18.942728 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:18.943251 (+ 523us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:18.944750 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:18.946879 (+ 2129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:18.948418 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:18.949524 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:18.949739 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:18.954336 (+ 4597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:18.954349 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:18.954373 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:18.954434 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:18.958553 (+ 4119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:18.959514 (+ 961us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:18.959525 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:18.959536 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:18.959805 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:18.960205 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:18.960210 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:18.960213 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:18.960996 (+ 783us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:18.961286 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:18.961935 (+ 649us) server_negotiation.cc:299] Negotiation successful
0805 23:04:18.962469 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":344,"threads_started":1}
I20260805 23:04:18.964041 11826 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: No bootstrap required, opened a new log
I20260805 23:04:18.973131 11826 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:18.973654 11826 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:04:18.973744 11826 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92dc9f8901c1440ebede1ccfed7fc964, State: Initialized, Role: FOLLOWER
I20260805 23:04:18.974387 11826 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:18.974640 11826 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:04:18.974756 11826 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:04:18.974957 11826 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:04:18.977699 11826 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:18.978322 11826 leader_election.cc:302] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92dc9f8901c1440ebede1ccfed7fc964; no voters:
I20260805 23:04:18.978976 11826 leader_election.cc:288] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:04:18.979126 11834 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:04:18.979920 11834 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 LEADER]: Becoming Leader. State: Replica: 92dc9f8901c1440ebede1ccfed7fc964, State: Running, Role: LEADER
I20260805 23:04:18.980671 11834 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:18.982055 11826 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:04:18.983768 11836 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92dc9f8901c1440ebede1ccfed7fc964. Latest consensus state: current_term: 1 leader_uuid: "92dc9f8901c1440ebede1ccfed7fc964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } } }
I20260805 23:04:18.984474 11836 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: This master's current role is: LEADER
I20260805 23:04:18.983768 11835 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92dc9f8901c1440ebede1ccfed7fc964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } } }
I20260805 23:04:18.986029 11835 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: This master's current role is: LEADER
I20260805 23:04:18.987658 11839 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:04:18.995411 11839 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:04:19.006352 11839 catalog_manager.cc:1347] Generated new cluster ID: cf439f1ee4f94a41a96012249bfb658e
I20260805 23:04:19.006507 11839 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:04:19.033074 11839 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:04:19.034951 11839 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:04:19.049284 11839 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Generated new TSK 0
I20260805 23:04:19.050387 11839 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:04:19.128039 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35221
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:04:19.503947 11859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:19.504279 11859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:19.504406 11859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:19.512508 11859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:19.512687 11859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:19.512873 11859 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:04:19.523388 11859 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:19.524863 11859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:19.526547 11859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:19.541026 11866 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:19.540999 11872 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:19.540953 11867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:19.541998 11859 server_base.cc:1034] running on GCE node
I20260805 23:04:19.542786 11859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:19.543937 11859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:19.545199 11859 hybrid_clock.cc:648] HybridClock initialized: now 1785971059545127 us; error 68 us; skew 500 ppm
I20260805 23:04:19.545565 11859 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:19 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971059, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:19.549113 11859 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:04:19.550700 11859 webserver.cc:460] Webserver started at http://127.22.45.65:44007/ using document root <none> and password file <none>
I20260805 23:04:19.551458 11859 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:19.551570 11859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:19.551851 11859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:04:19.555058 11859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c"
format_stamp: "Formatted at 2026-08-05 23:04:19 on dist-test-slave-1vmg"
server_key: "3c55b80171b79ce9c500b92ffd041f35"
server_key_iv: "c976e857ebcd00a04b1a69519f74b131"
server_key_version: "encryptionkey@0"
I20260805 23:04:19.555869 11859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c"
format_stamp: "Formatted at 2026-08-05 23:04:19 on dist-test-slave-1vmg"
server_key: "3c55b80171b79ce9c500b92ffd041f35"
server_key_iv: "c976e857ebcd00a04b1a69519f74b131"
server_key_version: "encryptionkey@0"
I20260805 23:04:19.561822 11859 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260805 23:04:19.565948 11881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:19.567778 11859 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:04:19.567994 11859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c"
format_stamp: "Formatted at 2026-08-05 23:04:19 on dist-test-slave-1vmg"
server_key: "3c55b80171b79ce9c500b92ffd041f35"
server_key_iv: "c976e857ebcd00a04b1a69519f74b131"
server_key_version: "encryptionkey@0"
I20260805 23:04:19.568246 11859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:19.588081 11859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:19.592679 11859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:19.593011 11859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:19.594115 11859 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:19.595692 11859 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:19.595780 11859 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:19.595916 11859 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:19.595973 11859 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:19.627876 11859 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:43625
I20260805 23:04:19.627939 12029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:43625 every 8 connection(s)
I20260805 23:04:19.629297 11859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:04:19.630606 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 11859
I20260805 23:04:19.630853 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:04:19.631705 22709 external_mini_cluster.cc:1428] Setting key 167f922b5b9db6c3ef2a9305d72e351f
Aug 05 23:04:19 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971059, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:04:19.652834 12033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:19.632493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:60307 (local address 127.22.45.126:35221)
0805 23:04:19.632991 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:19.632996 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:19.634183 (+ 1187us) server_negotiation.cc:407] Connection header received
0805 23:04:19.636714 (+ 2531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:19.636720 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:19.636789 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:19.636886 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:19.638964 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:19.639721 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:19.641934 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:19.642346 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:19.642443 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:19.646646 (+ 4203us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:19.646652 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:19.646656 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:19.646693 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:19.649323 (+ 2630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:19.650189 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:19.650194 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:19.650196 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:19.650353 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:19.650837 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:19.650841 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:19.650843 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:19.651190 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:19.651356 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:19.652146 (+ 790us) server_negotiation.cc:299] Negotiation successful
0805 23:04:19.652415 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":258,"threads_started":1}
I20260805 23:04:19.654222 12034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:19.633081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:60307)
0805 23:04:19.633983 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:19.634041 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:19.636405 (+ 2364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:19.637170 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:19.637182 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:19.637936 (+ 754us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:04:19.638764 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:19.638790 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:19.639918 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:19.639924 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:19.641800 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:19.641816 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:19.642589 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:19.642596 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:19.642892 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:19.643690 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:04:19.643728 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:04:19.646376 (+ 2648us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:04:19.649513 (+ 3137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:19.649525 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:19.649542 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:19.650039 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:19.650476 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:19.650481 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:19.650485 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:19.650711 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:19.651329 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:04:19.651338 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:04:19.651740 (+ 402us) client_negotiation.cc:769] Sending connection context
0805 23:04:19.652027 (+ 287us) client_negotiation.cc:240] Negotiation successful
0805 23:04:19.652645 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":351,"threads_started":1}
I20260805 23:04:19.656323 12031 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35221
I20260805 23:04:19.656680 12031 heartbeater.cc:464] Registering TS with master...
I20260805 23:04:19.657512 12031 heartbeater.cc:511] Master 127.22.45.126:35221 requested a full tablet report, sending...
I20260805 23:04:19.660065 11779 ts_manager.cc:194] Registered new tserver with Master: 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625)
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
I20260805 23:04:19.661674 11779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:60307
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:04:19.696007 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35221
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:04:20.049642 12038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:20.050015 12038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:20.050179 12038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:20.057899 12038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:20.058090 12038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:20.058262 12038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:04:20.068847 12038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:20.070384 12038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:20.072090 12038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:20.087039 12044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:20.086905 12047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:20.086957 12045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:20.092605 12038 server_base.cc:1034] running on GCE node
I20260805 23:04:20.093402 12038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:20.094555 12038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:20.095786 12038 hybrid_clock.cc:648] HybridClock initialized: now 1785971060095734 us; error 52 us; skew 500 ppm
I20260805 23:04:20.096154 12038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:20 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971060, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:20.099742 12038 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:04:20.101593 12038 webserver.cc:460] Webserver started at http://127.22.45.66:33375/ using document root <none> and password file <none>
I20260805 23:04:20.102401 12038 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:20.102520 12038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:20.102825 12038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:04:20.106277 12038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "b440f44efc6948e0af5a9049c6e27845"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "483b3dd8abc968294a24fe743d2b45c6"
server_key_iv: "a8902582f6476befad40b499e310b58a"
server_key_version: "encryptionkey@0"
I20260805 23:04:20.107273 12038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "b440f44efc6948e0af5a9049c6e27845"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "483b3dd8abc968294a24fe743d2b45c6"
server_key_iv: "a8902582f6476befad40b499e310b58a"
server_key_version: "encryptionkey@0"
I20260805 23:04:20.113540 12038 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:04:20.117940 12056 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:20.119618 12038 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:04:20.119838 12038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "b440f44efc6948e0af5a9049c6e27845"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "483b3dd8abc968294a24fe743d2b45c6"
server_key_iv: "a8902582f6476befad40b499e310b58a"
server_key_version: "encryptionkey@0"
I20260805 23:04:20.120093 12038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:20.167469 12038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:20.172609 12038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:20.172951 12038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:20.174144 12038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:20.175758 12038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:20.175846 12038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:20.175977 12038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:20.176038 12038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:20.209363 12038 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:44341
I20260805 23:04:20.209411 12203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:44341 every 8 connection(s)
I20260805 23:04:20.210791 12038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:04:20.218065 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 12038
I20260805 23:04:20.218269 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:04:20.218724 22709 external_mini_cluster.cc:1428] Setting key 621117f281e34203600ed45e17016fec
Aug 05 23:04:20 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971060, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:04:20.232899 12206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.213709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:45301 (local address 127.22.45.126:35221)
0805 23:04:20.214194 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:20.214198 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:20.215249 (+ 1051us) server_negotiation.cc:407] Connection header received
0805 23:04:20.217185 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:20.217190 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:20.217275 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:20.217383 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:20.219092 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.219991 (+ 899us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.221735 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.222193 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.222316 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.226380 (+ 4064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:20.226386 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:20.226389 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:20.226428 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:20.229213 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:20.230148 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:20.230152 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:20.230155 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:20.230308 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:20.230832 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:20.230837 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:20.230839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:20.231211 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:20.231371 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:20.232374 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0805 23:04:20.232613 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":239,"threads_started":1}
I20260805 23:04:20.234217 12207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.214285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:45301)
0805 23:04:20.215076 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:20.215125 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:20.216866 (+ 1741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:20.217592 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:20.217601 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:20.218193 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:04:20.218857 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.218882 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.220171 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.220175 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.221579 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.221594 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.222440 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.222449 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.222697 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.223465 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:04:20.223493 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:04:20.226061 (+ 2568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:04:20.229428 (+ 3367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:20.229439 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:20.229456 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:20.229970 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:20.230441 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:20.230447 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:20.230451 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:20.230694 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:20.231370 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:04:20.231380 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:04:20.231840 (+ 460us) client_negotiation.cc:769] Sending connection context
0805 23:04:20.232218 (+ 378us) client_negotiation.cc:240] Negotiation successful
0805 23:04:20.232879 (+ 661us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":283,"threads_started":1}
I20260805 23:04:20.236042 12204 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35221
I20260805 23:04:20.236382 12204 heartbeater.cc:464] Registering TS with master...
I20260805 23:04:20.237191 12204 heartbeater.cc:511] Master 127.22.45.126:35221 requested a full tablet report, sending...
I20260805 23:04:20.238962 11779 ts_manager.cc:194] Registered new tserver with Master: b440f44efc6948e0af5a9049c6e27845 (127.22.45.66:44341)
I20260805 23:04:20.239857 11779 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:45301
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:04:20.282284 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35221
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:04:20.636332 12210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:20.636631 12210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:20.636730 12210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:20.644239 12210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:20.644373 12210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:20.644496 12210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:04:20.654402 12210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:20.655728 12210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:20.657069 12210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 23:04:20.665581 12031 heartbeater.cc:503] Master 127.22.45.126:35221 was elected leader, sending a full tablet report...
W20260805 23:04:20.671202 12217 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:20.671150 12218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:20.671222 12220 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:20.672350 12210 server_base.cc:1034] running on GCE node
I20260805 23:04:20.673048 12210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:20.674196 12210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:20.675428 12210 hybrid_clock.cc:648] HybridClock initialized: now 1785971060675374 us; error 48 us; skew 500 ppm
I20260805 23:04:20.675818 12210 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:20 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971060, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:20.679589 12210 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:04:20.681350 12210 webserver.cc:460] Webserver started at http://127.22.45.67:40237/ using document root <none> and password file <none>
I20260805 23:04:20.682235 12210 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:20.682377 12210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:20.682715 12210 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:04:20.685964 12210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "ad1470e8dbdf2849127bf3359ee6fc63"
server_key_iv: "d9f1e17da71ea2822eca0de522579860"
server_key_version: "encryptionkey@0"
I20260805 23:04:20.686796 12210 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "ad1470e8dbdf2849127bf3359ee6fc63"
server_key_iv: "d9f1e17da71ea2822eca0de522579860"
server_key_version: "encryptionkey@0"
I20260805 23:04:20.692520 12210 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260805 23:04:20.696100 12229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:20.697470 12210 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:04:20.697642 12210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "ad1470e8dbdf2849127bf3359ee6fc63"
server_key_iv: "d9f1e17da71ea2822eca0de522579860"
server_key_version: "encryptionkey@0"
I20260805 23:04:20.697834 12210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:20.710904 12210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:20.715533 12210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:20.715835 12210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:20.717018 12210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:20.719112 12210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:20.719213 12210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:20.719348 12210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:20.719403 12210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:20.754024 12210 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46371
I20260805 23:04:20.754061 12376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46371 every 8 connection(s)
I20260805 23:04:20.755468 12210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:04:20.763532 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 12210
I20260805 23:04:20.763763 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:04:20.764286 22709 external_mini_cluster.cc:1428] Setting key 873e5ac2f1f502633851d91fb4ccd649
Aug 05 23:04:20 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971060, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:04:20.776827 12380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.758215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:50299 (local address 127.22.45.126:35221)
0805 23:04:20.758668 (+ 453us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:20.758674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:20.759693 (+ 1019us) server_negotiation.cc:407] Connection header received
0805 23:04:20.761669 (+ 1976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:20.761675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:20.761785 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:20.761889 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:20.763928 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.764800 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.766615 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.767269 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.767404 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.771066 (+ 3662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:20.771072 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:20.771075 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:20.771114 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:20.773894 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:20.774662 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:20.774666 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:20.774668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:20.774801 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:20.775215 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:20.775218 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:20.775220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:20.775507 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:20.775636 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:20.776342 (+ 706us) server_negotiation.cc:299] Negotiation successful
0805 23:04:20.776551 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":219,"threads_started":1}
I20260805 23:04:20.777870 12381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.758712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:50299)
0805 23:04:20.759513 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:20.759568 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:20.761349 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:20.762167 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:20.762178 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:20.762785 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:04:20.763667 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.763711 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.764987 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.764991 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.766473 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.766488 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.767511 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.767518 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.767785 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.768442 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:04:20.768467 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:04:20.770754 (+ 2287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:04:20.774045 (+ 3291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:20.774054 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:20.774072 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:20.774559 (+ 487us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:20.774885 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:20.774888 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:20.774890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:20.775127 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:20.775605 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:04:20.775611 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:04:20.775986 (+ 375us) client_negotiation.cc:769] Sending connection context
0805 23:04:20.776234 (+ 248us) client_negotiation.cc:240] Negotiation successful
0805 23:04:20.776681 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":339,"threads_started":1}
I20260805 23:04:20.779333 12377 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35221
I20260805 23:04:20.779671 12377 heartbeater.cc:464] Registering TS with master...
I20260805 23:04:20.780464 12377 heartbeater.cc:511] Master 127.22.45.126:35221 requested a full tablet report, sending...
I20260805 23:04:20.781870 11777 ts_manager.cc:194] Registered new tserver with Master: 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371)
I20260805 23:04:20.782797 11777 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:50299
I20260805 23:04:20.792773 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:04:20.812048 12380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.797686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57442 (local address 127.22.45.126:35221)
0805 23:04:20.797908 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:20.797915 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:20.798308 (+ 393us) server_negotiation.cc:407] Connection header received
0805 23:04:20.798469 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:20.798473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:20.798550 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:20.798639 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:20.800226 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.800997 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.802628 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.803156 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.803272 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.805814 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:20.805819 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:20.805823 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:20.805862 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:20.808885 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:20.809787 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:20.809792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:20.809794 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:20.809970 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:20.810342 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:20.810345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:20.810347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:20.810768 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:20.811070 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:20.811466 (+ 396us) server_negotiation.cc:299] Negotiation successful
0805 23:04:20.811702 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 23:04:20.816748 11777 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:04:20.824272 11777 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:04:20.847927 12393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.838683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44282 (local address 127.22.45.65:43625)
0805 23:04:20.839451 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:20.839462 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:20.839493 (+ 31us) server_negotiation.cc:407] Connection header received
0805 23:04:20.839597 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:20.839606 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:20.839879 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:20.840078 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:20.841137 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.842626 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.845084 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.846554 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.846711 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.846994 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:20.847400 (+ 406us) server_negotiation.cc:299] Negotiation successful
0805 23:04:20.847584 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":406,"threads_started":1}
I20260805 23:04:20.848014 12392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.838330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43625 (local address 127.0.0.1:44282)
0805 23:04:20.839110 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:20.839170 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:20.839376 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:20.840447 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:20.840456 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:20.840495 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:20.840905 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.840922 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.842808 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.842814 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.844905 (+ 2091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.844919 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.846909 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.846940 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.847158 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.847198 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 23:04:20.847326 (+ 128us) client_negotiation.cc:240] Negotiation successful
0805 23:04:20.847539 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"mutex_wait_us":2,"thread_start_us":343,"threads_started":1}
I20260805 23:04:20.849207 12394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.839606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46371 (local address 127.0.0.1:43260)
0805 23:04:20.840142 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:20.840161 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:20.840285 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:20.841546 (+ 1261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:20.841551 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:20.841579 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:20.842080 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.842095 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.844098 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.844104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.846371 (+ 2267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.846386 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.848358 (+ 1972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.848363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.848547 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.848583 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:04:20.848654 (+ 71us) client_negotiation.cc:240] Negotiation successful
0805 23:04:20.848795 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":35,"thread_start_us":269,"threads_started":1}
I20260805 23:04:20.850662 12395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.839981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43260 (local address 127.22.45.67:46371)
0805 23:04:20.840911 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:20.840920 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:20.840952 (+ 32us) server_negotiation.cc:407] Connection header received
0805 23:04:20.841061 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:20.841069 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:20.841316 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:20.841553 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:20.842319 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.843947 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.846592 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.848135 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.849813 (+ 1678us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.850056 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:20.850156 (+ 100us) server_negotiation.cc:299] Negotiation successful
0805 23:04:20.850332 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":759,"thread_start_us":584,"threads_started":1}
I20260805 23:04:20.850976 12397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.840869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:44341 (local address 127.0.0.1:57652)
0805 23:04:20.842295 (+ 1426us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:20.842314 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:20.842434 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:20.843392 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:20.843396 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:20.843422 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:20.843792 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.843801 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.845758 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.845763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.847981 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:20.847997 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.850146 (+ 2149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.850151 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:20.850319 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.850351 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 23:04:20.850438 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 23:04:20.850594 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1277,"mutex_wait_us":27,"thread_start_us":1090,"threads_started":1}
I20260805 23:04:20.851207 12396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:20.840535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57652 (local address 127.22.45.66:44341)
0805 23:04:20.841173 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:20.841181 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:20.842584 (+ 1403us) server_negotiation.cc:407] Connection header received
0805 23:04:20.842695 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:20.842702 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:20.842977 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:20.843180 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:20.843964 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.845560 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.848197 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:20.849671 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:20.849804 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:20.849998 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:20.850678 (+ 680us) server_negotiation.cc:299] Negotiation successful
0805 23:04:20.850847 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":484,"threads_started":1}
I20260805 23:04:20.852631 11943 tablet_service.cc:1467] Processing CreateTablet for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 (DEFAULT_TABLE table=test-table [id=ae2b75772d734e0aaf9339147402c33e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:04:20.854282 11943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:04:20.854269 12293 tablet_service.cc:1467] Processing CreateTablet for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 (DEFAULT_TABLE table=test-table [id=ae2b75772d734e0aaf9339147402c33e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:04:20.854738 12120 tablet_service.cc:1467] Processing CreateTablet for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 (DEFAULT_TABLE table=test-table [id=ae2b75772d734e0aaf9339147402c33e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:04:20.855672 12293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:04:20.856142 12120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:04:20.867736 12399 tablet_bootstrap.cc:492] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Bootstrap starting.
I20260805 23:04:20.869361 12400 tablet_bootstrap.cc:492] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Bootstrap starting.
I20260805 23:04:20.870833 12402 tablet_bootstrap.cc:492] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Bootstrap starting.
I20260805 23:04:20.873137 12400 tablet_bootstrap.cc:654] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Neither blocks nor log segments found. Creating new log.
I20260805 23:04:20.873139 12399 tablet_bootstrap.cc:654] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Neither blocks nor log segments found. Creating new log.
I20260805 23:04:20.874210 12402 tablet_bootstrap.cc:654] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Neither blocks nor log segments found. Creating new log.
I20260805 23:04:20.874640 12400 log.cc:824] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:20.875202 12399 log.cc:824] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:20.875470 12402 log.cc:824] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:20.878265 12402 tablet_bootstrap.cc:492] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: No bootstrap required, opened a new log
I20260805 23:04:20.878309 12400 tablet_bootstrap.cc:492] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: No bootstrap required, opened a new log
I20260805 23:04:20.878403 12399 tablet_bootstrap.cc:492] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: No bootstrap required, opened a new log
I20260805 23:04:20.878573 12402 ts_tablet_manager.cc:1397] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260805 23:04:20.878623 12400 ts_tablet_manager.cc:1397] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260805 23:04:20.878644 12399 ts_tablet_manager.cc:1397] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.006s
I20260805 23:04:20.887044 12402 raft_consensus.cc:348] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:20.887496 12402 raft_consensus.cc:374] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:04:20.887620 12402 raft_consensus.cc:729] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b440f44efc6948e0af5a9049c6e27845, State: Initialized, Role: FOLLOWER
I20260805 23:04:20.888294 12402 consensus_queue.cc:260] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:20.889744 12204 heartbeater.cc:503] Master 127.22.45.126:35221 was elected leader, sending a full tablet report...
I20260805 23:04:20.889824 12399 raft_consensus.cc:348] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:20.889824 12400 raft_consensus.cc:348] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:20.890308 12400 raft_consensus.cc:374] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:04:20.890309 12399 raft_consensus.cc:374] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:04:20.890408 12399 raft_consensus.cc:729] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02dcfe2488ea4b10b8ccb321eb7c6fe2, State: Initialized, Role: FOLLOWER
I20260805 23:04:20.890408 12400 raft_consensus.cc:729] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c019c9f4a88466d9cf7ebc74ebcf32c, State: Initialized, Role: FOLLOWER
I20260805 23:04:20.890537 12402 ts_tablet_manager.cc:1428] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260805 23:04:20.891109 12399 consensus_queue.cc:260] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:20.891103 12400 consensus_queue.cc:260] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:20.895576 12377 heartbeater.cc:503] Master 127.22.45.126:35221 was elected leader, sending a full tablet report...
I20260805 23:04:20.896358 12399 ts_tablet_manager.cc:1428] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Time spent starting tablet: real 0.018s user 0.010s sys 0.008s
I20260805 23:04:20.897941 12400 ts_tablet_manager.cc:1428] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Time spent starting tablet: real 0.019s user 0.007s sys 0.008s
W20260805 23:04:20.963158 12205 tablet.cc:2369] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:04:21.007229 12379 tablet.cc:2369] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:04:21.064532 12408 raft_consensus.cc:482] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:04:21.064918 12408 raft_consensus.cc:504] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:21.066779 12408 leader_election.cc:288] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625), 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371)
I20260805 23:04:21.074342 12393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.067258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:40335 (local address 127.22.45.65:43625)
0805 23:04:21.067509 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:21.067517 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:21.067981 (+ 464us) server_negotiation.cc:407] Connection header received
0805 23:04:21.068267 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:21.068273 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:21.068360 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:21.068459 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:21.069188 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.070108 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.072262 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.073256 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.073392 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.073452 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:21.073924 (+ 472us) server_negotiation.cc:299] Negotiation successful
0805 23:04:21.074090 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:04:21.074455 12413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.067184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43625 (local address 127.22.45.66:40335)
0805 23:04:21.067853 (+ 669us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:21.067875 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:21.068102 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:21.068595 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:21.068599 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:21.068626 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:21.069018 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:21.069031 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.070258 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.070264 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:21.072076 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:21.072095 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.073474 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.073480 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:21.073677 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.073712 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:04:21.073890 (+ 178us) client_negotiation.cc:240] Negotiation successful
0805 23:04:21.074041 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":34,"thread_start_us":305,"threads_started":1}
I20260805 23:04:21.074636 12395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.068281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:43005 (local address 127.22.45.67:46371)
0805 23:04:21.068488 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:21.068494 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:21.068807 (+ 313us) server_negotiation.cc:407] Connection header received
0805 23:04:21.068944 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:21.068950 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:21.069029 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:21.069140 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:21.069727 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.070653 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.072667 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.073691 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.073856 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.073928 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:21.074256 (+ 328us) server_negotiation.cc:299] Negotiation successful
0805 23:04:21.074397 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260805 23:04:21.074983 12415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.067959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46371 (local address 127.22.45.66:43005)
0805 23:04:21.068694 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:21.068709 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:21.068822 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:21.069167 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:21.069171 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:21.069195 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:21.069575 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:21.069587 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.070802 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.070806 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:21.072502 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:21.072518 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.073894 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.073900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:21.074088 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.074118 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 23:04:21.074215 (+ 97us) client_negotiation.cc:240] Negotiation successful
0805 23:04:21.074345 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"mutex_wait_us":47,"thread_start_us":375,"threads_started":1}
I20260805 23:04:21.075707 11969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cb526aa1b64db0bc6a0c01aafc6ec4" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" is_pre_election: true
I20260805 23:04:21.075986 12322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cb526aa1b64db0bc6a0c01aafc6ec4" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" is_pre_election: true
I20260805 23:04:21.076233 11969 raft_consensus.cc:2454] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 0.
I20260805 23:04:21.076462 12322 raft_consensus.cc:2454] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 0.
I20260805 23:04:21.076947 12060 leader_election.cc:302] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c019c9f4a88466d9cf7ebc74ebcf32c, b440f44efc6948e0af5a9049c6e27845; no voters:
I20260805 23:04:21.077315 12408 raft_consensus.cc:2781] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:04:21.077448 12408 raft_consensus.cc:482] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:04:21.077554 12408 raft_consensus.cc:3037] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:04:21.079897 12408 raft_consensus.cc:504] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:21.080554 12408 leader_election.cc:288] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 election: Requested vote from peers 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625), 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371)
I20260805 23:04:21.081146 11969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cb526aa1b64db0bc6a0c01aafc6ec4" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c"
I20260805 23:04:21.081182 12322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7cb526aa1b64db0bc6a0c01aafc6ec4" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2"
I20260805 23:04:21.081362 11969 raft_consensus.cc:3037] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:04:21.081365 12322 raft_consensus.cc:3037] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:04:21.084031 12322 raft_consensus.cc:2454] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 1.
I20260805 23:04:21.084167 11969 raft_consensus.cc:2454] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 1.
I20260805 23:04:21.084455 12060 leader_election.cc:302] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02dcfe2488ea4b10b8ccb321eb7c6fe2, b440f44efc6948e0af5a9049c6e27845; no voters:
I20260805 23:04:21.084775 12408 raft_consensus.cc:2781] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:04:21.085227 12408 raft_consensus.cc:686] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 1 LEADER]: Becoming Leader. State: Replica: b440f44efc6948e0af5a9049c6e27845, State: Running, Role: LEADER
I20260805 23:04:21.085711 12408 consensus_queue.cc:237] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } }
I20260805 23:04:21.091034 11777 catalog_manager.cc:5495] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 reported cstate change: term changed from 0 to 1, leader changed from <none> to b440f44efc6948e0af5a9049c6e27845 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "b440f44efc6948e0af5a9049c6e27845" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } health_report { overall_health: HEALTHY } } }
W20260805 23:04:21.132301 12032 tablet.cc:2369] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:04:21.154856 12396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.149200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57660 (local address 127.22.45.66:44341)
0805 23:04:21.149443 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:21.149450 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:21.149470 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:04:21.149697 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:21.149701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:21.149788 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:21.149933 (+ 145us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:04:21.150327 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.151118 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.152603 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.153004 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.153119 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.153654 (+ 535us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:04:21.154206 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:04:21.154373 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:21.154469 (+ 96us) server_negotiation.cc:299] Negotiation successful
0805 23:04:21.154574 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 23:04:21.163594 12322 raft_consensus.cc:1261] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Refusing update from remote peer b440f44efc6948e0af5a9049c6e27845: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:04:21.163594 11969 raft_consensus.cc:1261] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Refusing update from remote peer b440f44efc6948e0af5a9049c6e27845: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:04:21.164678 12416 consensus_queue.cc:1035] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:04:21.165058 12408 consensus_queue.cc:1035] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:04:21.193689 11776 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:04:21.194037 11776 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:04:21.198599 11776 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Sending DeleteTablet for 3 replicas of tablet e7cb526aa1b64db0bc6a0c01aafc6ec4
I20260805 23:04:21.200238 12120 tablet_service.cc:1514] Processing DeleteTablet for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:04:21 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:57652
I20260805 23:04:21.200387 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 11859
I20260805 23:04:21.200569 11943 tablet_service.cc:1514] Processing DeleteTablet for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:04:21 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:44282
I20260805 23:04:21.201363 12293 tablet_service.cc:1514] Processing DeleteTablet for tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:04:21 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:43260
I20260805 23:04:21.218281 12433 tablet_replica.cc:330] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: stopping tablet replica
I20260805 23:04:21.218833 12433 raft_consensus.cc:2229] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:04:21.219763 12434 tablet_replica.cc:330] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: stopping tablet replica
I20260805 23:04:21.220418 12434 raft_consensus.cc:2229] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:04:21.220822 12437 tablet_replica.cc:330] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: stopping tablet replica
I20260805 23:04:21.221078 12434 raft_consensus.cc:2258] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:04:21.221607 12437 raft_consensus.cc:2229] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:04:21.222038 12433 raft_consensus.cc:2258] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:04:21.222244 12437 raft_consensus.cc:2258] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:04:21.225122 12437 ts_tablet_manager.cc:1905] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:04:21.226596 12434 ts_tablet_manager.cc:1905] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:04:21.229044 12433 ts_tablet_manager.cc:1905] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 05 23:04:21 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:04:21.235302 12437 ts_tablet_manager.cc:1918] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:04:21.235535 12437 log.cc:1196] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/e7cb526aa1b64db0bc6a0c01aafc6ec4
I20260805 23:04:21.236091 12437 ts_tablet_manager.cc:1939] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Deleting consensus metadata
I20260805 23:04:21.238502 11761 catalog_manager.cc:4841] TS 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371): tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 (table test-table [id=ae2b75772d734e0aaf9339147402c33e]) successfully deleted
I20260805 23:04:21.241686 12434 ts_tablet_manager.cc:1918] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:04:21.241942 12434 log.cc:1196] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/e7cb526aa1b64db0bc6a0c01aafc6ec4
I20260805 23:04:21.242547 12434 ts_tablet_manager.cc:1939] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P 3c019c9f4a88466d9cf7ebc74ebcf32c: Deleting consensus metadata
I20260805 23:04:21.244733 11761 catalog_manager.cc:4841] TS 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625): tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 (table test-table [id=ae2b75772d734e0aaf9339147402c33e]) successfully deleted
I20260805 23:04:21.246161 12433 ts_tablet_manager.cc:1918] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:04:21.246423 12433 log.cc:1196] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/e7cb526aa1b64db0bc6a0c01aafc6ec4
I20260805 23:04:21.246698 12393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.201671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.22.45.65:43625)
0805 23:04:21.201859 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:21.201865 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:21.211246 (+ 9381us) server_negotiation.cc:407] Connection header received
0805 23:04:21.211825 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:21.211832 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:21.211947 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:21.212024 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:21.214282 (+ 2258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.215564 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.222697 (+ 7133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.223471 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.223611 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.237294 (+ 13683us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:21.237313 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:21.237332 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:21.237393 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:21.242355 (+ 4962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:21.243599 (+ 1244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:21.243610 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:21.243613 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:21.243805 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:21.244320 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:21.244325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:21.244328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:21.245236 (+ 908us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:21.245526 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:21.245918 (+ 392us) server_negotiation.cc:299] Negotiation successful
0805 23:04:21.246160 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:04:21.247020 12433 ts_tablet_manager.cc:1939] T e7cb526aa1b64db0bc6a0c01aafc6ec4 P b440f44efc6948e0af5a9049c6e27845: Deleting consensus metadata
I20260805 23:04:21.247347 12025 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:21.249128 11761 catalog_manager.cc:4841] TS b440f44efc6948e0af5a9049c6e27845 (127.22.45.66:44341): tablet e7cb526aa1b64db0bc6a0c01aafc6ec4 (table test-table [id=ae2b75772d734e0aaf9339147402c33e]) successfully deleted
I20260805 23:04:21.354350 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 11859
I20260805 23:04:21.377786 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 12038
Aug 05 23:04:21 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:04:21.396544 12396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.378737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57664 (local address 127.22.45.66:44341)
0805 23:04:21.378965 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:21.378971 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:21.378993 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:04:21.379225 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:21.379229 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:21.379303 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:21.379396 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:21.380960 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.381930 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.383517 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.384033 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.384160 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.389220 (+ 5060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:21.389240 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:21.389258 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:21.389325 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:21.392983 (+ 3658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:21.393904 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:21.393914 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:21.393916 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:21.394088 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:21.394589 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:21.394596 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:21.394599 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:21.395241 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:21.395662 (+ 421us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:21.395873 (+ 211us) server_negotiation.cc:299] Negotiation successful
0805 23:04:21.396136 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260805 23:04:21.397330 12198 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:21.513444 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 12038
I20260805 23:04:21.533912 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 12210
Aug 05 23:04:21 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971057, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:04:21.550071 12395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:21.534755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.22.45.67:46371)
0805 23:04:21.534985 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:21.534998 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:21.535021 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:04:21.535153 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:21.535157 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:21.535225 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:21.535312 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:21.536662 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.537403 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.538779 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:21.539234 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:21.539351 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:21.543934 (+ 4583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:21.543953 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:21.543971 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:21.544038 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:21.546725 (+ 2687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:21.547717 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:21.547726 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:21.547729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:21.547939 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:21.548378 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:21.548384 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:21.548388 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:21.548806 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:21.549117 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:21.549461 (+ 344us) server_negotiation.cc:299] Negotiation successful
0805 23:04:21.549705 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:04:21.550801 12371 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:21.640471 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 12210
I20260805 23:04:21.661820 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 11736
I20260805 23:04:21.663189 11819 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:21.788558 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 11736
I20260805 23:04:41.816357 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35221
--webserver_interface=127.22.45.126
--webserver_port=39129
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:35221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:04:42.192109 12442 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:42.192459 12442 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:42.192601 12442 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:42.200570 12442 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 23:04:42.200711 12442 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 23:04:42.200791 12442 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 23:04:42.200866 12442 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:04:42.200947 12442 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:42.201053 12442 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:42.201115 12442 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:04:42.201196 12442 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:04:42.212229 12442 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:35221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=39129
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:42.213742 12442 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:42.215224 12442 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:42.242482 12449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:42.242544 12450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:42.242555 12452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:42.243552 12442 server_base.cc:1034] running on GCE node
I20260805 23:04:42.244602 12442 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:42.246479 12442 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:42.247748 12442 hybrid_clock.cc:648] HybridClock initialized: now 1785971082247661 us; error 55 us; skew 500 ppm
I20260805 23:04:42.248198 12442 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:42 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971082, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:42.252194 12442 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:04:42.254212 12442 webserver.cc:460] Webserver started at http://127.22.45.126:39129/ using document root <none> and password file <none>
I20260805 23:04:42.255191 12442 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:42.255334 12442 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:42.262645 12442 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.001s
I20260805 23:04:42.266342 12461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:42.268121 12442 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:04:42.268337 12442 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "92dc9f8901c1440ebede1ccfed7fc964"
format_stamp: "Formatted at 2026-08-05 23:04:18 on dist-test-slave-1vmg"
server_key: "40fbcf7833c4c4a46261d6b36062ac03"
server_key_iv: "099079d804df5610a7883db064a76b8d"
server_key_version: "encryptionkey@0"
I20260805 23:04:42.269547 12442 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:42.283628 12442 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:42.288812 12442 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:42.289121 12442 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:42.310415 12442 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:35221
I20260805 23:04:42.310431 12530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:35221 every 8 connection(s)
I20260805 23:04:42.312321 12442 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:04:42.316841 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 12442
I20260805 23:04:42.317916 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:43625
--local_ip_for_outbound_sockets=127.22.45.65
--tserver_master_addrs=127.22.45.126:35221
--webserver_port=44007
--webserver_interface=127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:04:42.322064 12532 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:04:42.327152 12532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Bootstrap starting.
I20260805 23:04:42.354192 12532 log.cc:824] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:42.372056 12532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:04:42.372849 12532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Bootstrap complete.
I20260805 23:04:42.387334 12532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:42.388693 12532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92dc9f8901c1440ebede1ccfed7fc964, State: Initialized, Role: FOLLOWER
I20260805 23:04:42.389632 12532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:42.390005 12532 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:04:42.390152 12532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:04:42.390353 12532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 1 FOLLOWER]: Advancing to term 2
I20260805 23:04:42.396930 12532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:42.397835 12532 leader_election.cc:302] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92dc9f8901c1440ebede1ccfed7fc964; no voters:
I20260805 23:04:42.398757 12532 leader_election.cc:288] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260805 23:04:42.398885 12537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 FOLLOWER]: Leader election won for term 2
I20260805 23:04:42.400175 12537 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 LEADER]: Becoming Leader. State: Replica: 92dc9f8901c1440ebede1ccfed7fc964, State: Running, Role: LEADER
I20260805 23:04:42.400853 12537 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:04:42.401682 12532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:04:42.403388 12539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92dc9f8901c1440ebede1ccfed7fc964. Latest consensus state: current_term: 2 leader_uuid: "92dc9f8901c1440ebede1ccfed7fc964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } } }
I20260805 23:04:42.403824 12539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: This master's current role is: LEADER
I20260805 23:04:42.404439 12538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "92dc9f8901c1440ebede1ccfed7fc964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } } }
I20260805 23:04:42.404778 12538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: This master's current role is: LEADER
I20260805 23:04:42.416064 12542 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:04:42.425343 12542 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:04:42.427117 12542 catalog_manager.cc:1259] Loaded cluster ID: cf439f1ee4f94a41a96012249bfb658e
I20260805 23:04:42.427348 12542 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:04:42.431808 12542 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:04:42.433789 12542 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Loaded TSK: 0
I20260805 23:04:42.448019 12557 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 23:04:42.466355 12542 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Generated new TSK 1
I20260805 23:04:42.466831 12542 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 23:04:42.733685 12534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:42.734069 12534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:42.734220 12534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:42.741973 12534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:42.742130 12534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:42.742283 12534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:04:42.752506 12534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:43625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=44007
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:42.753931 12534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:42.755450 12534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:42.774281 12566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:42.774794 12568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:42.775224 12565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:42.775841 12534 server_base.cc:1034] running on GCE node
I20260805 23:04:42.776633 12534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:42.777859 12534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:42.779100 12534 hybrid_clock.cc:648] HybridClock initialized: now 1785971082779032 us; error 71 us; skew 500 ppm
I20260805 23:04:42.779488 12534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:42 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971082, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:42.783224 12534 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:04:42.788552 12534 webserver.cc:460] Webserver started at http://127.22.45.65:44007/ using document root <none> and password file <none>
I20260805 23:04:42.789413 12534 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:42.789608 12534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:42.796532 12534 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260805 23:04:42.801163 12580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:42.803272 12534 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260805 23:04:42.803476 12534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c"
format_stamp: "Formatted at 2026-08-05 23:04:19 on dist-test-slave-1vmg"
server_key: "3c55b80171b79ce9c500b92ffd041f35"
server_key_iv: "c976e857ebcd00a04b1a69519f74b131"
server_key_version: "encryptionkey@0"
I20260805 23:04:42.804592 12534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:42.823220 12534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:42.828197 12534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:42.828528 12534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:42.829698 12534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:42.831266 12534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:42.831368 12534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:42.831485 12534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:42.831568 12534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:42.866149 12534 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:43625
I20260805 23:04:42.866214 12731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:43625 every 8 connection(s)
I20260805 23:04:42.867846 12534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:04:42.878338 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 12534
I20260805 23:04:42.879173 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:44341
--local_ip_for_outbound_sockets=127.22.45.66
--tserver_master_addrs=127.22.45.126:35221
--webserver_port=33375
--webserver_interface=127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:04:42 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971082, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:04:42.895506 12735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:42.871639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:53053)
0805 23:04:42.872459 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:42.872499 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:42.874323 (+ 1824us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:42.875899 (+ 1576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:42.875907 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:42.876486 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:04:42.877075 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:42.877095 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:42.879085 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:42.879092 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:42.881047 (+ 1955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:42.881065 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:42.882199 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:42.882206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:42.882493 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:42.883421 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:04:42.883453 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:04:42.886360 (+ 2907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:04:42.890154 (+ 3794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:42.890165 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:42.890183 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:42.890849 (+ 666us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:42.891584 (+ 735us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:42.891589 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:42.891591 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:42.891829 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:42.892877 (+ 1048us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:04:42.892884 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:04:42.893247 (+ 363us) client_negotiation.cc:769] Sending connection context
0805 23:04:42.893500 (+ 253us) client_negotiation.cc:240] Negotiation successful
0805 23:04:42.894152 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":324,"threads_started":1}
I20260805 23:04:42.895753 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:42.871366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:53053 (local address 127.22.45.126:35221)
0805 23:04:42.872034 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:42.872054 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:42.872646 (+ 592us) server_negotiation.cc:407] Connection header received
0805 23:04:42.874960 (+ 2314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:42.874978 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:42.875399 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:42.875721 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:42.877343 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:42.878821 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:42.881247 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:42.881939 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:42.882117 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:42.886733 (+ 4616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:42.886743 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:42.886760 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:42.886817 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:42.889954 (+ 3137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:42.891078 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:42.891090 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:42.891099 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:42.891389 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:42.891965 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:42.891971 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:42.891974 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:42.892741 (+ 767us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:42.892933 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:42.893793 (+ 860us) server_negotiation.cc:299] Negotiation successful
0805 23:04:42.894430 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":252,"threads_started":1}
I20260805 23:04:42.898882 12732 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35221
I20260805 23:04:42.899246 12732 heartbeater.cc:464] Registering TS with master...
I20260805 23:04:42.900082 12732 heartbeater.cc:511] Master 127.22.45.126:35221 requested a full tablet report, sending...
I20260805 23:04:42.903290 12486 ts_manager.cc:194] Registered new tserver with Master: 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625)
I20260805 23:04:42.905392 12486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:53053
W20260805 23:04:43.241417 12736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:43.241792 12736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:43.241935 12736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:43.249607 12736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:43.249784 12736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:43.249953 12736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:04:43.261116 12736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:44341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=33375
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:43.262763 12736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:43.264326 12736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:43.278820 12744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:43.278944 12747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:43.278852 12745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:43.280030 12736 server_base.cc:1034] running on GCE node
I20260805 23:04:43.280735 12736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:43.281777 12736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:43.283008 12736 hybrid_clock.cc:648] HybridClock initialized: now 1785971083282962 us; error 48 us; skew 500 ppm
I20260805 23:04:43.283349 12736 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:43 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971083, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:43.286695 12736 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:04:43.288304 12736 webserver.cc:460] Webserver started at http://127.22.45.66:33375/ using document root <none> and password file <none>
I20260805 23:04:43.289011 12736 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:43.289136 12736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:43.294893 12736 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:04:43.297695 12756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:43.299132 12736 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260805 23:04:43.299304 12736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "b440f44efc6948e0af5a9049c6e27845"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "483b3dd8abc968294a24fe743d2b45c6"
server_key_iv: "a8902582f6476befad40b499e310b58a"
server_key_version: "encryptionkey@0"
I20260805 23:04:43.300482 12736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:43.333214 12736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:43.337965 12736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:43.338253 12736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:43.339391 12736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:43.340879 12736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:43.340978 12736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:43.341094 12736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:43.341164 12736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:43.372905 12736 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:44341
I20260805 23:04:43.372953 12906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:44341 every 8 connection(s)
I20260805 23:04:43.374365 12736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:04:43.374874 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 12736
I20260805 23:04:43.375681 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:46371
--local_ip_for_outbound_sockets=127.22.45.67
--tserver_master_addrs=127.22.45.126:35221
--webserver_port=40237
--webserver_interface=127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 05 23:04:43 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971083, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:04:43.396358 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.377257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:49173 (local address 127.22.45.126:35221)
0805 23:04:43.377448 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.377452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.378861 (+ 1409us) server_negotiation.cc:407] Connection header received
0805 23:04:43.380855 (+ 1994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.380861 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.380962 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.381083 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:43.382790 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.383570 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.385273 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.385742 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.385863 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.390134 (+ 4271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:43.390140 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:43.390143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:43.390191 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:43.392895 (+ 2704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.393734 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.393740 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.393742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.393877 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.394341 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.394346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.394348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.394743 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:43.394892 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:43.395707 (+ 815us) server_negotiation.cc:299] Negotiation successful
0805 23:04:43.395986 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 23:04:43.397578 12909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.377903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:49173)
0805 23:04:43.378689 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:43.378730 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:43.380543 (+ 1813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:43.381372 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:43.381381 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:43.381954 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:04:43.382595 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.382617 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.383752 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.383756 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.385081 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.385111 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.385996 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.386004 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.386265 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.387073 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:04:43.387098 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:04:43.389825 (+ 2727us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:04:43.393069 (+ 3244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:43.393080 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:43.393098 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:43.393597 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:43.393994 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:43.393999 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:43.394002 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:43.394221 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:43.394877 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:04:43.394886 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:04:43.395320 (+ 434us) client_negotiation.cc:769] Sending connection context
0805 23:04:43.395596 (+ 276us) client_negotiation.cc:240] Negotiation successful
0805 23:04:43.396309 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":314,"threads_started":1}
I20260805 23:04:43.399344 12907 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35221
I20260805 23:04:43.399785 12907 heartbeater.cc:464] Registering TS with master...
I20260805 23:04:43.400848 12907 heartbeater.cc:511] Master 127.22.45.126:35221 requested a full tablet report, sending...
I20260805 23:04:43.402897 12486 ts_manager.cc:194] Registered new tserver with Master: b440f44efc6948e0af5a9049c6e27845 (127.22.45.66:44341)
I20260805 23:04:43.404214 12486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:49173
W20260805 23:04:43.735015 12910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:04:43.735361 12910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:04:43.735505 12910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:04:43.743163 12910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:04:43.743326 12910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:04:43.743458 12910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:04:43.753716 12910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:46371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=40237
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:04:43.755146 12910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:04:43.756577 12910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:04:43.770188 12918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:43.770305 12919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:04:43.770278 12922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:04:43.771447 12910 server_base.cc:1034] running on GCE node
I20260805 23:04:43.772178 12910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:04:43.773327 12910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:04:43.774737 12910 hybrid_clock.cc:648] HybridClock initialized: now 1785971083774649 us; error 78 us; skew 500 ppm
I20260805 23:04:43.775197 12910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:04:43 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971083, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:04:43.778818 12910 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:04:43.780892 12910 webserver.cc:460] Webserver started at http://127.22.45.67:40237/ using document root <none> and password file <none>
I20260805 23:04:43.781687 12910 fs_manager.cc:359] Metadata directory not provided
I20260805 23:04:43.781832 12910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:04:43.788915 12910 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:04:43.792593 12932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:43.794435 12910 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:04:43.794658 12910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "ad1470e8dbdf2849127bf3359ee6fc63"
server_key_iv: "d9f1e17da71ea2822eca0de522579860"
server_key_version: "encryptionkey@0"
I20260805 23:04:43.795877 12910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:04:43.818298 12910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:04:43.824348 12910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:04:43.824610 12910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:04:43.825824 12910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:04:43.827368 12910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:04:43.827481 12910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:43.827570 12910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:04:43.827627 12910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:04:43.859702 12910 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46371
I20260805 23:04:43.859776 13069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46371 every 8 connection(s)
I20260805 23:04:43.861250 12910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:04:43.868721 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 12910
Aug 05 23:04:43 dist-test-slave-1vmg krb5kdc[11720](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971083, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:04:43.892150 13074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.869870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34030 (local address 127.22.45.126:35221)
0805 23:04:43.870846 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.870851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.871177 (+ 326us) server_negotiation.cc:407] Connection header received
0805 23:04:43.871303 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.871309 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.871386 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.871493 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:43.873089 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.874146 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.875602 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.876055 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.876175 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.879256 (+ 3081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:43.879263 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:43.879268 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:43.879327 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:43.888152 (+ 8825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.889497 (+ 1345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.889502 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.889505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.889666 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.890174 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.890180 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.890183 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.890615 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:43.890979 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:43.891344 (+ 365us) server_negotiation.cc:299] Negotiation successful
0805 23:04:43.891665 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":853,"thread_start_us":699,"threads_started":1}
I20260805 23:04:43.892235 12734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.863927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:60709 (local address 127.22.45.126:35221)
0805 23:04:43.864109 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.864114 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.865248 (+ 1134us) server_negotiation.cc:407] Connection header received
0805 23:04:43.867204 (+ 1956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.867211 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.867296 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.867386 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:43.869274 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.870426 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.872433 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.872877 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.872991 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.876982 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:43.876987 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:43.876990 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:43.877023 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:43.880050 (+ 3027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.881297 (+ 1247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.881303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.881307 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.883425 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.889992 (+ 6567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.889997 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.890000 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.890384 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:43.890538 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:43.891621 (+ 1083us) server_negotiation.cc:299] Negotiation successful
0805 23:04:43.891858 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 23:04:43.894966 13072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.864384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:60709)
0805 23:04:43.865067 (+ 683us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:43.865112 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:43.866867 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:43.867656 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:43.867664 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:43.868233 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:04:43.869054 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.869083 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.870708 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.870714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.872281 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.872296 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.873107 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.873115 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.873367 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.874246 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:04:43.874271 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:04:43.876770 (+ 2499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:04:43.880219 (+ 3449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:43.880228 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:43.880254 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:43.880912 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:43.889454 (+ 8542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:04:43.889459 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:04:43.889462 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:04:43.889822 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:04:43.890540 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:04:43.890551 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:04:43.891096 (+ 545us) client_negotiation.cc:769] Sending connection context
0805 23:04:43.892534 (+ 1438us) client_negotiation.cc:240] Negotiation successful
0805 23:04:43.893286 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":264,"threads_started":1}
I20260805 23:04:43.896782 13070 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35221
I20260805 23:04:43.897109 13070 heartbeater.cc:464] Registering TS with master...
I20260805 23:04:43.897925 13070 heartbeater.cc:511] Master 127.22.45.126:35221 requested a full tablet report, sending...
I20260805 23:04:43.899603 12486 ts_manager.cc:194] Registered new tserver with Master: 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371)
I20260805 23:04:43.900542 12486 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:60709
I20260805 23:04:43.908767 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:04:43.909232 12732 heartbeater.cc:503] Master 127.22.45.126:35221 was elected leader, sending a full tablet report...
I20260805 23:04:43.918119 13074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.910026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34032 (local address 127.22.45.126:35221)
0805 23:04:43.910236 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.910242 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.911525 (+ 1283us) server_negotiation.cc:407] Connection header received
0805 23:04:43.911744 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.911751 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.911958 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.912129 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:04:43.912555 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.913697 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.915404 (+ 1707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.916127 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.916267 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.916903 (+ 636us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:04:43.917321 (+ 418us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0805 23:04:43.917800 (+ 479us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34032: token expired
Metrics: {"server-negotiator.queue_time_us":57}
W20260805 23:04:43.918274 13074 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34032: token expired
W20260805 23:04:43.918740 12386 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.45.126:35221)
I20260805 23:04:43.933033 13074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.919374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34046 (local address 127.22.45.126:35221)
0805 23:04:43.919580 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.919586 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.919604 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:04:43.919719 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.919737 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.919808 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.919890 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:43.921401 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.922182 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.923781 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.924217 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.924337 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.927287 (+ 2950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:43.927293 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:43.927297 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:43.927338 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:43.930089 (+ 2751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.930896 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.930903 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.930905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.931099 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:43.931475 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:43.931481 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:43.931483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:43.931863 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:43.932107 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:43.932434 (+ 327us) server_negotiation.cc:299] Negotiation successful
0805 23:04:43.932698 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:04:43.937184 12486 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:04:43.946691 12486 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:04:43.974360 13086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.962323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43625 (local address 127.0.0.1:39682)
0805 23:04:43.962943 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:43.962964 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:43.963086 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:43.964519 (+ 1433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:43.964529 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:43.964566 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:43.965059 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.965073 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.967726 (+ 2653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.967734 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.970499 (+ 2765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.970528 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.973068 (+ 2540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.973077 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.973391 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.973467 (+ 76us) client_negotiation.cc:769] Sending connection context
0805 23:04:43.973615 (+ 148us) client_negotiation.cc:240] Negotiation successful
0805 23:04:43.973897 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":1141,"threads_started":1}
I20260805 23:04:43.976722 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.963021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39682 (local address 127.22.45.65:43625)
0805 23:04:43.963733 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.963744 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.963779 (+ 35us) server_negotiation.cc:407] Connection header received
0805 23:04:43.963908 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.963917 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.964230 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.965325 (+ 1095us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:43.965621 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.967486 (+ 1865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.970844 (+ 3358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.972678 (+ 1834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.975565 (+ 2887us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.975969 (+ 404us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:43.976073 (+ 104us) server_negotiation.cc:299] Negotiation successful
0805 23:04:43.976314 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":506,"thread_start_us":1521,"threads_started":1}
I20260805 23:04:43.984684 12645 tablet_service.cc:1467] Processing CreateTablet for tablet 648ab9e7f4ff4f499fee3055ac9069cd (DEFAULT_TABLE table=test-table [id=7c51415bf2cc49b292df6e0f348940a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:04:43.986977 12645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 648ab9e7f4ff4f499fee3055ac9069cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:04:43.988807 13086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.964896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46371 (local address 127.0.0.1:35872)
0805 23:04:43.975144 (+ 10248us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:43.975174 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:43.975340 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:43.979169 (+ 3829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:43.979176 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:43.979213 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:43.979473 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.979485 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.983200 (+ 3715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.983206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.985213 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.985234 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.987443 (+ 2209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.987449 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.988105 (+ 656us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.988154 (+ 49us) client_negotiation.cc:769] Sending connection context
0805 23:04:43.988241 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 23:04:43.988408 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10111,"mutex_wait_us":401,"thread_start_us":12548,"threads_started":1}
I20260805 23:04:43.989773 13088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.964226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35872 (local address 127.22.45.67:46371)
0805 23:04:43.978281 (+ 14055us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.978293 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.978336 (+ 43us) server_negotiation.cc:407] Connection header received
0805 23:04:43.978464 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.978475 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.978841 (+ 366us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.979700 (+ 859us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:43.980089 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.981992 (+ 1903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.985478 (+ 3486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.987223 (+ 1745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.987641 (+ 418us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.987920 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:43.989151 (+ 1231us) server_negotiation.cc:299] Negotiation successful
0805 23:04:43.989365 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13809,"spinlock_wait_cycles":24832,"thread_start_us":13811,"threads_started":1}
I20260805 23:04:43.991154 13084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.960897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:44341 (local address 127.0.0.1:35950)
0805 23:04:43.961837 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:43.961887 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:43.962102 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:43.983358 (+ 21256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:43.983363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:43.983402 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:43.983877 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.983892 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.986033 (+ 2141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.986039 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.988067 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:43.988086 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.990257 (+ 2171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.990264 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:43.990454 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.990494 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 23:04:43.990568 (+ 74us) client_negotiation.cc:240] Negotiation successful
0805 23:04:43.990737 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"mutex_wait_us":86,"thread_start_us":444,"threads_started":1}
I20260805 23:04:43.993098 13085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:43.961169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35950 (local address 127.22.45.66:44341)
0805 23:04:43.982654 (+ 21485us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:43.982664 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:43.982694 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:04:43.982799 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:43.982807 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:43.983129 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:43.984086 (+ 957us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:43.984349 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.985846 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.988309 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:43.989886 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:43.991498 (+ 1612us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:43.992480 (+ 982us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:43.992566 (+ 86us) server_negotiation.cc:299] Negotiation successful
0805 23:04:43.992772 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21297,"thread_start_us":21136,"threads_started":1}
I20260805 23:04:43.995076 12992 tablet_service.cc:1467] Processing CreateTablet for tablet 648ab9e7f4ff4f499fee3055ac9069cd (DEFAULT_TABLE table=test-table [id=7c51415bf2cc49b292df6e0f348940a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:04:43.996978 12992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 648ab9e7f4ff4f499fee3055ac9069cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:04:43.997639 12825 tablet_service.cc:1467] Processing CreateTablet for tablet 648ab9e7f4ff4f499fee3055ac9069cd (DEFAULT_TABLE table=test-table [id=7c51415bf2cc49b292df6e0f348940a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:04:43.999567 12825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 648ab9e7f4ff4f499fee3055ac9069cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:04:44.013490 13090 tablet_bootstrap.cc:492] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Bootstrap starting.
I20260805 23:04:44.021453 13090 tablet_bootstrap.cc:654] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Neither blocks nor log segments found. Creating new log.
I20260805 23:04:44.023137 13090 log.cc:824] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:44.027935 13091 tablet_bootstrap.cc:492] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Bootstrap starting.
I20260805 23:04:44.033027 13091 tablet_bootstrap.cc:654] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Neither blocks nor log segments found. Creating new log.
I20260805 23:04:44.034991 13091 log.cc:824] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:44.039847 13092 tablet_bootstrap.cc:492] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Bootstrap starting.
I20260805 23:04:44.044268 13092 tablet_bootstrap.cc:654] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Neither blocks nor log segments found. Creating new log.
I20260805 23:04:44.044450 13091 tablet_bootstrap.cc:492] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: No bootstrap required, opened a new log
I20260805 23:04:44.044482 13090 tablet_bootstrap.cc:492] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: No bootstrap required, opened a new log
I20260805 23:04:44.044834 13090 ts_tablet_manager.cc:1397] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Time spent bootstrapping tablet: real 0.032s user 0.019s sys 0.008s
I20260805 23:04:44.044835 13091 ts_tablet_manager.cc:1397] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.005s
I20260805 23:04:44.046103 13092 log.cc:824] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Log is configured to *not* fsync() on all Append() calls
I20260805 23:04:44.056020 13091 raft_consensus.cc:348] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.056020 13090 raft_consensus.cc:348] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.056800 13091 raft_consensus.cc:374] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:04:44.056978 13091 raft_consensus.cc:729] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b440f44efc6948e0af5a9049c6e27845, State: Initialized, Role: FOLLOWER
I20260805 23:04:44.057338 13090 raft_consensus.cc:374] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:04:44.057547 13090 raft_consensus.cc:729] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c019c9f4a88466d9cf7ebc74ebcf32c, State: Initialized, Role: FOLLOWER
I20260805 23:04:44.058032 13091 consensus_queue.cc:260] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.058329 13090 consensus_queue.cc:260] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.060607 13092 tablet_bootstrap.cc:492] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: No bootstrap required, opened a new log
I20260805 23:04:44.061110 13092 ts_tablet_manager.cc:1397] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Time spent bootstrapping tablet: real 0.022s user 0.015s sys 0.004s
I20260805 23:04:44.065596 12907 heartbeater.cc:503] Master 127.22.45.126:35221 was elected leader, sending a full tablet report...
I20260805 23:04:44.066839 13091 ts_tablet_manager.cc:1428] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Time spent starting tablet: real 0.022s user 0.010s sys 0.010s
I20260805 23:04:44.068646 13090 ts_tablet_manager.cc:1428] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Time spent starting tablet: real 0.024s user 0.009s sys 0.013s
I20260805 23:04:44.077351 13092 raft_consensus.cc:348] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.077932 13092 raft_consensus.cc:374] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:04:44.078049 13092 raft_consensus.cc:729] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02dcfe2488ea4b10b8ccb321eb7c6fe2, State: Initialized, Role: FOLLOWER
I20260805 23:04:44.078810 13092 consensus_queue.cc:260] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.080097 13070 heartbeater.cc:503] Master 127.22.45.126:35221 was elected leader, sending a full tablet report...
I20260805 23:04:44.080983 13092 ts_tablet_manager.cc:1428] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Time spent starting tablet: real 0.020s user 0.011s sys 0.004s
W20260805 23:04:44.112917 13071 tablet.cc:2369] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:04:44.120486 12733 tablet.cc:2369] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:04:44.126574 12908 tablet.cc:2369] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:04:44.237159 13096 raft_consensus.cc:482] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:04:44.237498 13096 raft_consensus.cc:504] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.239305 13096 leader_election.cc:288] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625), 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371)
I20260805 23:04:44.241300 13097 raft_consensus.cc:482] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:04:44.241595 13097 raft_consensus.cc:504] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.243734 13097 leader_election.cc:288] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b440f44efc6948e0af5a9049c6e27845 (127.22.45.66:44341), 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371)
I20260805 23:04:44.248601 13088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.240822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:48155 (local address 127.22.45.67:46371)
0805 23:04:44.241002 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.241007 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.241418 (+ 411us) server_negotiation.cc:407] Connection header received
0805 23:04:44.241619 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.241624 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.241697 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.241783 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:44.242344 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.243142 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.245979 (+ 2837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.247315 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.247472 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.247549 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.248211 (+ 662us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.248354 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260805 23:04:44.248737 13100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.240660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46371 (local address 127.22.45.66:48155)
0805 23:04:44.241321 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:44.241335 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:44.241484 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:44.241819 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:44.241824 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:44.241848 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:44.242189 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.242198 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.243329 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.243334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.245780 (+ 2446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.245798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.247813 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.247820 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.247996 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.248032 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:04:44.248178 (+ 146us) client_negotiation.cc:240] Negotiation successful
0805 23:04:44.248327 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"mutex_wait_us":48,"thread_start_us":344,"threads_started":1}
I20260805 23:04:44.249805 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.239805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:39573 (local address 127.22.45.65:43625)
0805 23:04:44.240038 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.240044 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.240700 (+ 656us) server_negotiation.cc:407] Connection header received
0805 23:04:44.240942 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.240949 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.241036 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.241129 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:44.241917 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.243069 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.246002 (+ 2933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.247356 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.247472 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.247549 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.249379 (+ 1830us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.249532 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:04:44.250031 13016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648ab9e7f4ff4f499fee3055ac9069cd" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" is_pre_election: true
I20260805 23:04:44.250540 13099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.239799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:43625 (local address 127.22.45.66:39573)
0805 23:04:44.240586 (+ 787us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:44.240604 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:44.240777 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:44.241270 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:44.241276 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:44.241314 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:44.241724 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.241739 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.243209 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.243214 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.245808 (+ 2594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.245818 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.248989 (+ 3171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.248997 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.249173 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.249208 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:04:44.249997 (+ 789us) client_negotiation.cc:240] Negotiation successful
0805 23:04:44.250154 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":290,"thread_start_us":420,"threads_started":1}
I20260805 23:04:44.250684 13016 raft_consensus.cc:2454] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 0.
I20260805 23:04:44.251458 12759 leader_election.cc:302] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02dcfe2488ea4b10b8ccb321eb7c6fe2, b440f44efc6948e0af5a9049c6e27845; no voters:
I20260805 23:04:44.251896 13096 raft_consensus.cc:2781] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:04:44.252067 13096 raft_consensus.cc:482] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:04:44.252170 13096 raft_consensus.cc:3037] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:04:44.252853 12669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648ab9e7f4ff4f499fee3055ac9069cd" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" is_pre_election: true
I20260805 23:04:44.253274 13085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.244277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:47929 (local address 127.22.45.66:44341)
0805 23:04:44.244482 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.244492 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.245068 (+ 576us) server_negotiation.cc:407] Connection header received
0805 23:04:44.245363 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.245369 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.245444 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.245506 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:44.246416 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.247553 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.250469 (+ 2916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.251871 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.252007 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.252080 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.252855 (+ 775us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.252997 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260805 23:04:44.253371 12669 raft_consensus.cc:2454] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 0.
I20260805 23:04:44.254114 13101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.244228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:44341 (local address 127.22.45.65:47929)
0805 23:04:44.244961 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:44.244986 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:44.245179 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:44.245718 (+ 539us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:44.245723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:44.245753 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:44.246244 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.246256 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.247768 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.247773 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.250254 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.250273 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.252440 (+ 2167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.252446 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.252646 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.252682 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:04:44.253445 (+ 763us) client_negotiation.cc:240] Negotiation successful
0805 23:04:44.253736 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"mutex_wait_us":100,"thread_start_us":393,"threads_started":1}
I20260805 23:04:44.255067 12856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648ab9e7f4ff4f499fee3055ac9069cd" candidate_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b440f44efc6948e0af5a9049c6e27845" is_pre_election: true
I20260805 23:04:44.255668 13096 raft_consensus.cc:504] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.256136 12856 raft_consensus.cc:2379] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3c019c9f4a88466d9cf7ebc74ebcf32c in current term 1: Already voted for candidate b440f44efc6948e0af5a9049c6e27845 in this term.
I20260805 23:04:44.256331 13096 leader_election.cc:288] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 election: Requested vote from peers 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625), 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371)
I20260805 23:04:44.256902 13016 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648ab9e7f4ff4f499fee3055ac9069cd" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2"
I20260805 23:04:44.256976 12669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648ab9e7f4ff4f499fee3055ac9069cd" candidate_uuid: "b440f44efc6948e0af5a9049c6e27845" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c"
I20260805 23:04:44.257136 13016 raft_consensus.cc:3037] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:04:44.257194 12669 raft_consensus.cc:3037] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:04:44.259518 13103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.245499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:38893 (local address 127.22.45.67:46371)
0805 23:04:44.248125 (+ 2626us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.248131 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.252708 (+ 4577us) server_negotiation.cc:407] Connection header received
0805 23:04:44.252791 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.252795 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.252871 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.252963 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:04:44.253876 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.255085 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.257335 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.258383 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.258575 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.258655 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.258989 (+ 334us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.259147 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2492,"thread_start_us":2271,"threads_started":1}
I20260805 23:04:44.259531 13102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.245128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:46371 (local address 127.22.45.65:38893)
0805 23:04:44.252400 (+ 7272us) negotiation.cc:107] Waiting for socket to connect
0805 23:04:44.252424 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:04:44.252587 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:04:44.253221 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:04:44.253225 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:04:44.253252 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:04:44.253648 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.253659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.255240 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.255245 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.257122 (+ 1877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:04:44.257138 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.258619 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.258625 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:04:44.258795 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.258825 (+ 30us) client_negotiation.cc:769] Sending connection context
0805 23:04:44.258942 (+ 117us) client_negotiation.cc:240] Negotiation successful
0805 23:04:44.259095 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7112,"mutex_wait_us":3,"thread_start_us":6861,"threads_started":1}
I20260805 23:04:44.260326 13014 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "648ab9e7f4ff4f499fee3055ac9069cd" candidate_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" is_pre_election: true
I20260805 23:04:44.260663 13016 raft_consensus.cc:2454] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 1.
I20260805 23:04:44.260653 12669 raft_consensus.cc:2454] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b440f44efc6948e0af5a9049c6e27845 in term 1.
I20260805 23:04:44.261111 12759 leader_election.cc:302] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c019c9f4a88466d9cf7ebc74ebcf32c, b440f44efc6948e0af5a9049c6e27845; no voters:
I20260805 23:04:44.261247 12586 leader_election.cc:302] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c019c9f4a88466d9cf7ebc74ebcf32c; no voters: 02dcfe2488ea4b10b8ccb321eb7c6fe2, b440f44efc6948e0af5a9049c6e27845
I20260805 23:04:44.261441 13096 raft_consensus.cc:2781] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:04:44.261667 13097 raft_consensus.cc:2726] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260805 23:04:44.261991 13096 raft_consensus.cc:686] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 1 LEADER]: Becoming Leader. State: Replica: b440f44efc6948e0af5a9049c6e27845, State: Running, Role: LEADER
I20260805 23:04:44.262504 13096 consensus_queue.cc:237] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } }
I20260805 23:04:44.267767 12485 catalog_manager.cc:5495] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 reported cstate change: term changed from 0 to 1, leader changed from <none> to b440f44efc6948e0af5a9049c6e27845 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "b440f44efc6948e0af5a9049c6e27845" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b440f44efc6948e0af5a9049c6e27845" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 } health_report { overall_health: UNKNOWN } } }
I20260805 23:04:44.303880 13085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.298391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35960 (local address 127.22.45.66:44341)
0805 23:04:44.298580 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.298586 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.298624 (+ 38us) server_negotiation.cc:407] Connection header received
0805 23:04:44.298869 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.298874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.299008 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.299170 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:04:44.299577 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.300327 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.301687 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.302102 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.302206 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.302747 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:04:44.303362 (+ 615us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:04:44.303475 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.303560 (+ 85us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.303635 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 23:04:44.312801 13014 raft_consensus.cc:1261] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Refusing update from remote peer b440f44efc6948e0af5a9049c6e27845: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:04:44.312949 12669 raft_consensus.cc:1261] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Refusing update from remote peer b440f44efc6948e0af5a9049c6e27845: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:04:44.313695 13104 consensus_queue.cc:1035] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [LEADER]: Connected to new peer: Peer: permanent_uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:04:44.314121 13096 consensus_queue.cc:1035] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 43625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:04:44.328732 13108 mvcc.cc:205] Tried to move back new op lower bound from 7315337561334403072 to 7315337561143541760. Current Snapshot: MvccSnapshot[applied={T|T < 7315337561334403072}]
I20260805 23:04:44.343645 12485 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:04:44.343936 12485 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:04:44.347745 12485 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Sending DeleteTablet for 3 replicas of tablet 648ab9e7f4ff4f499fee3055ac9069cd
I20260805 23:04:44.349005 12825 tablet_service.cc:1514] Processing DeleteTablet for tablet 648ab9e7f4ff4f499fee3055ac9069cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:04:44 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:35950
I20260805 23:04:44.349172 12645 tablet_service.cc:1514] Processing DeleteTablet for tablet 648ab9e7f4ff4f499fee3055ac9069cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:04:44 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:39682
I20260805 23:04:44.349269 12992 tablet_service.cc:1514] Processing DeleteTablet for tablet 648ab9e7f4ff4f499fee3055ac9069cd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:04:44 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:35872
I20260805 23:04:44.349709 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 12534
I20260805 23:04:44.351378 13123 tablet_replica.cc:330] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: stopping tablet replica
I20260805 23:04:44.351866 13123 raft_consensus.cc:2229] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:04:44.352335 13123 raft_consensus.cc:2258] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:04:44.362552 13121 tablet_replica.cc:330] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: stopping tablet replica
I20260805 23:04:44.363237 13121 raft_consensus.cc:2229] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:04:44.364001 13121 raft_consensus.cc:2258] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:04:44.364859 13122 tablet_replica.cc:330] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: stopping tablet replica
I20260805 23:04:44.365346 13122 raft_consensus.cc:2229] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:04:44.365957 13122 raft_consensus.cc:2258] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:04:44.367602 13121 ts_tablet_manager.cc:1905] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:04:44.368232 13122 ts_tablet_manager.cc:1905] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:04:44.374152 13123 ts_tablet_manager.cc:1905] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:04:44.375962 13122 ts_tablet_manager.cc:1918] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:04:44.376276 13122 log.cc:1196] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/648ab9e7f4ff4f499fee3055ac9069cd
I20260805 23:04:44.377265 13122 ts_tablet_manager.cc:1939] T 648ab9e7f4ff4f499fee3055ac9069cd P 3c019c9f4a88466d9cf7ebc74ebcf32c: Deleting consensus metadata
I20260805 23:04:44.376662 13087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.350907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39688 (local address 127.22.45.65:43625)
0805 23:04:44.351119 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.351125 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.351146 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:04:44.351205 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.351210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.351302 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.351416 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:44.353429 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.354805 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.356871 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.357721 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.357869 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.361802 (+ 3933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:44.361826 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:44.361850 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:44.361908 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:44.367354 (+ 5446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:44.372009 (+ 4655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:44.372021 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:44.372024 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:44.372228 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:44.372848 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:44.372853 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:44.372857 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:44.373513 (+ 656us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:44.373873 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.375831 (+ 1958us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.376114 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:04:44.379747 12465 catalog_manager.cc:4841] TS 3c019c9f4a88466d9cf7ebc74ebcf32c (127.22.45.65:43625): tablet 648ab9e7f4ff4f499fee3055ac9069cd (table test-table [id=7c51415bf2cc49b292df6e0f348940a3]) successfully deleted
I20260805 23:04:44.380764 12727 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:44.382470 13121 ts_tablet_manager.cc:1918] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:04:44.382778 13121 log.cc:1196] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/648ab9e7f4ff4f499fee3055ac9069cd
I20260805 23:04:44.383579 13121 ts_tablet_manager.cc:1939] T 648ab9e7f4ff4f499fee3055ac9069cd P b440f44efc6948e0af5a9049c6e27845: Deleting consensus metadata
I20260805 23:04:44.385730 12465 catalog_manager.cc:4841] TS b440f44efc6948e0af5a9049c6e27845 (127.22.45.66:44341): tablet 648ab9e7f4ff4f499fee3055ac9069cd (table test-table [id=7c51415bf2cc49b292df6e0f348940a3]) successfully deleted
I20260805 23:04:44.392369 13123 ts_tablet_manager.cc:1918] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:04:44.392649 13123 log.cc:1196] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/648ab9e7f4ff4f499fee3055ac9069cd
I20260805 23:04:44.393257 13123 ts_tablet_manager.cc:1939] T 648ab9e7f4ff4f499fee3055ac9069cd P 02dcfe2488ea4b10b8ccb321eb7c6fe2: Deleting consensus metadata
I20260805 23:04:44.396183 12465 catalog_manager.cc:4841] TS 02dcfe2488ea4b10b8ccb321eb7c6fe2 (127.22.45.67:46371): tablet 648ab9e7f4ff4f499fee3055ac9069cd (table test-table [id=7c51415bf2cc49b292df6e0f348940a3]) successfully deleted
I20260805 23:04:44.506547 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 12534
I20260805 23:04:44.535243 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 12736
I20260805 23:04:44.557799 13085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.536241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35972 (local address 127.22.45.66:44341)
0805 23:04:44.536577 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.536586 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.536614 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:04:44.536697 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.536704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.536804 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.536940 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:44.538509 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.539798 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.541329 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.542069 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.542226 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.549368 (+ 7142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:44.549388 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:44.549410 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:44.549483 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:44.554041 (+ 4558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:44.555118 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:44.555130 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:44.555134 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:44.555355 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:44.555781 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:44.555786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:44.555790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:44.556374 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:44.556785 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.557135 (+ 350us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.557426 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260805 23:04:44.558679 12902 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:44.677327 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 12736
I20260805 23:04:44.698761 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 12910
I20260805 23:04:44.712617 13103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:04:44.699582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40268 (local address 127.22.45.67:46371)
0805 23:04:44.699767 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0805 23:04:44.699772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:04:44.699791 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:04:44.699962 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:04:44.699966 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:04:44.700034 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:04:44.700131 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:04:44.701535 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.702322 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.703836 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:04:44.704242 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:04:44.704341 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:04:44.707006 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:04:44.707022 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:04:44.707039 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:04:44.707075 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:04:44.709950 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:44.710748 (+ 798us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:44.710756 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:44.710758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:44.710893 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:04:44.711264 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:04:44.711266 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:04:44.711268 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:04:44.711623 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:04:44.711859 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0805 23:04:44.712072 (+ 213us) server_negotiation.cc:299] Negotiation successful
0805 23:04:44.712301 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260805 23:04:44.713279 13064 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:44.805109 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 12910
I20260805 23:04:44.830294 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 12442
I20260805 23:04:44.831599 12523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:04:44.948005 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 12442
I20260805 23:05:04.976734 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35221
--webserver_interface=127.22.45.126
--webserver_port=39129
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:35221
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:05.348965 13131 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:05.349299 13131 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:05.349424 13131 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:05.356994 13131 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260805 23:05:05.357120 13131 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260805 23:05:05.357159 13131 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260805 23:05:05.357232 13131 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:05.357309 13131 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:05.357414 13131 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:05.357470 13131 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:05.357548 13131 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:05.368297 13131 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:35221
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35221
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=39129
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:05.369760 13131 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:05.371284 13131 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:05.384395 13141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:05.384348 13143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:05.384334 13140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:05.385293 13131 server_base.cc:1034] running on GCE node
I20260805 23:05:05.386219 13131 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:05.387959 13131 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:05.389212 13131 hybrid_clock.cc:648] HybridClock initialized: now 1785971105389130 us; error 62 us; skew 500 ppm
I20260805 23:05:05.389611 13131 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:05 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971105, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:05.393356 13131 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:05:05.395241 13131 webserver.cc:460] Webserver started at http://127.22.45.126:39129/ using document root <none> and password file <none>
I20260805 23:05:05.396090 13131 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:05.396220 13131 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:05.402516 13131 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.003s
I20260805 23:05:05.405725 13150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:05.407279 13131 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:05.407459 13131 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "92dc9f8901c1440ebede1ccfed7fc964"
format_stamp: "Formatted at 2026-08-05 23:04:18 on dist-test-slave-1vmg"
server_key: "40fbcf7833c4c4a46261d6b36062ac03"
server_key_iv: "099079d804df5610a7883db064a76b8d"
server_key_version: "encryptionkey@0"
I20260805 23:05:05.408484 13131 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:05.427413 13131 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:05.431888 13131 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:05.432202 13131 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:05.451579 13131 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:35221
I20260805 23:05:05.451597 13223 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:35221 every 8 connection(s)
I20260805 23:05:05.453394 13131 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:05.459249 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 13131
I20260805 23:05:05.460427 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:43625
--local_ip_for_outbound_sockets=127.22.45.65
--tserver_master_addrs=127.22.45.126:35221
--webserver_port=44007
--webserver_interface=127.22.45.65
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:05:05.462224 13225 sys_catalog.cc:263] Verifying existing consensus state
I20260805 23:05:05.467126 13225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Bootstrap starting.
I20260805 23:05:05.489112 13225 log.cc:824] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:05.505970 13225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260805 23:05:05.506568 13225 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Bootstrap complete.
I20260805 23:05:05.516300 13225 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:05:05.517328 13225 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92dc9f8901c1440ebede1ccfed7fc964, State: Initialized, Role: FOLLOWER
I20260805 23:05:05.518086 13225 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:05:05.518380 13225 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:05.518545 13225 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:05.518739 13225 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 2 FOLLOWER]: Advancing to term 3
I20260805 23:05:05.523384 13225 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:05:05.524158 13225 leader_election.cc:302] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92dc9f8901c1440ebede1ccfed7fc964; no voters:
I20260805 23:05:05.525100 13225 leader_election.cc:288] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260805 23:05:05.525307 13229 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 3 FOLLOWER]: Leader election won for term 3
I20260805 23:05:05.526683 13229 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [term 3 LEADER]: Becoming Leader. State: Replica: 92dc9f8901c1440ebede1ccfed7fc964, State: Running, Role: LEADER
I20260805 23:05:05.527670 13229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } }
I20260805 23:05:05.528411 13225 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:05.530792 13231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92dc9f8901c1440ebede1ccfed7fc964. Latest consensus state: current_term: 3 leader_uuid: "92dc9f8901c1440ebede1ccfed7fc964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } } }
I20260805 23:05:05.531337 13231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:05.530895 13230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "92dc9f8901c1440ebede1ccfed7fc964" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92dc9f8901c1440ebede1ccfed7fc964" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35221 } } }
I20260805 23:05:05.531955 13230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:05.536353 13236 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:05.547610 13236 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:05.550313 13236 catalog_manager.cc:1259] Loaded cluster ID: cf439f1ee4f94a41a96012249bfb658e
I20260805 23:05:05.550551 13236 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:05.555423 13236 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:05.557543 13236 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Loaded TSK: 0
I20260805 23:05:05.557865 13236 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 92dc9f8901c1440ebede1ccfed7fc964: Loaded TSK: 1
F20260805 23:05:05.559283 13236 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7effef3449ad google::LogMessage::Fail() at ??:0
@ 0x7effef34788a google::LogMessage::SendToLog() at ??:0
@ 0x7effef3444de google::LogMessage::Flush() at ??:0
@ 0x7effef345a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7efff30a87d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7efff309773e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f0004d731c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f0004d72783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f0004dfe2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f0004dfe0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f0004e485e9 std::function<>::operator()() at ??:0
@ 0x7f0004d76cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f0004d74c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f0004dfc610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f0004dfc439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7efff1f90345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7efff1f9391c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7efff1f93799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7efff1f6eeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7efff52486db start_thread at ??:0
@ 0x7effee1de61f clone at ??:0
W20260805 23:05:05.912745 13227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:05.913091 13227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:05.913198 13227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:05.921080 13227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:05.921239 13227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:05.921361 13227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:05:05.932034 13227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:43625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=44007
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:05.933553 13227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:05.935148 13227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:05.950007 13291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:05.950080 13289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:05.950270 13288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:05.951040 13227 server_base.cc:1034] running on GCE node
I20260805 23:05:05.951740 13227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:05.952868 13227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:05.954077 13227 hybrid_clock.cc:648] HybridClock initialized: now 1785971105954011 us; error 63 us; skew 500 ppm
I20260805 23:05:05.954411 13227 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:05 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971105, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:05.957913 13227 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:05:05.959684 13227 webserver.cc:460] Webserver started at http://127.22.45.65:44007/ using document root <none> and password file <none>
I20260805 23:05:05.960484 13227 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:05.960623 13227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:05.966630 13227 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260805 23:05:05.969717 13305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:05.971216 13227 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:05.971388 13227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "3c019c9f4a88466d9cf7ebc74ebcf32c"
format_stamp: "Formatted at 2026-08-05 23:04:19 on dist-test-slave-1vmg"
server_key: "3c55b80171b79ce9c500b92ffd041f35"
server_key_iv: "c976e857ebcd00a04b1a69519f74b131"
server_key_version: "encryptionkey@0"
I20260805 23:05:05.972430 13227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:05.993628 13227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:05.998356 13227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:05.998657 13227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:05.999890 13227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:06.001446 13227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:06.001569 13227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:06.001701 13227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:06.001780 13227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:06.036191 13227 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:43625
I20260805 23:05:06.036257 13452 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:43625 every 8 connection(s)
I20260805 23:05:06.037742 13227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:05:06.042665 13455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:06.040807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:46937)
0805 23:05:06.041532 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:06.041775 (+ 243us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":286,"threads_started":1}
W20260805 23:05:06.043373 13453 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:35221 (0 consecutive failures): Network error: Failed to ping master at 127.22.45.126:35221: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
I20260805 23:05:06.044287 13455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:06.043901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:47551)
0805 23:05:06.044090 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:06.044173 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260805 23:05:06.045228 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 13227
I20260805 23:05:06.045265 13455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:06.044850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:58403)
0805 23:05:06.045013 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:06.045115 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260805 23:05:06.045565 13453 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 23:05:06.045985 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:44341
--local_ip_for_outbound_sockets=127.22.45.66
--tserver_master_addrs=127.22.45.126:35221
--webserver_port=33375
--webserver_interface=127.22.45.66
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:06.410143 13458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:06.410501 13458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:06.410640 13458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:06.418377 13458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:06.418531 13458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:06.418691 13458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:05:06.429303 13458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:44341
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=33375
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:06.431017 13458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:06.432461 13458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:06.445808 13464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:06.445855 13466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:06.445951 13468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:06.447103 13458 server_base.cc:1034] running on GCE node
I20260805 23:05:06.447770 13458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:06.448856 13458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:06.450079 13458 hybrid_clock.cc:648] HybridClock initialized: now 1785971106450031 us; error 41 us; skew 500 ppm
I20260805 23:05:06.450431 13458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:06 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971106, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:06.454319 13458 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:05:06.456223 13458 webserver.cc:460] Webserver started at http://127.22.45.66:33375/ using document root <none> and password file <none>
I20260805 23:05:06.457038 13458 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:06.457194 13458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:06.463704 13458 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:05:06.467228 13480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:06.468875 13458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:05:06.469089 13458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "b440f44efc6948e0af5a9049c6e27845"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "483b3dd8abc968294a24fe743d2b45c6"
server_key_iv: "a8902582f6476befad40b499e310b58a"
server_key_version: "encryptionkey@0"
I20260805 23:05:06.470252 13458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:06.497905 13458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:06.502714 13458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:06.503098 13458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:06.504227 13458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:06.505780 13458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:06.505896 13458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:06.506012 13458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:06.506085 13458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:06.540350 13458 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:44341
I20260805 23:05:06.540421 13627 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:44341 every 8 connection(s)
I20260805 23:05:06.542092 13458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:05:06.547484 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 13458
I20260805 23:05:06.548228 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:06.545617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:40303)
0805 23:05:06.546453 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:06.546758 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":301,"threads_started":1}
I20260805 23:05:06.548441 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:46371
--local_ip_for_outbound_sockets=127.22.45.67
--tserver_master_addrs=127.22.45.126:35221
--webserver_port=40237
--webserver_interface=127.22.45.67
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:06.549135 13630 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:35221 (0 consecutive failures): Network error: Failed to ping master at 127.22.45.126:35221: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
I20260805 23:05:06.550310 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:06.549837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:37689)
0805 23:05:06.550036 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:06.550142 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260805 23:05:06.551374 13633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:06.550955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:37393)
0805 23:05:06.551107 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:06.551218 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 23:05:06.551646 13630 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260805 23:05:06.908293 13634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:06.908659 13634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:06.908819 13634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:06.916561 13634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:06.916745 13634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:06.916909 13634 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:05:06.927407 13634 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:46371
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=40237
--tserver_master_addrs=127.22.45.126:35221
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:06.928884 13634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:06.930332 13634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:06.945030 13642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:06.945003 13641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:06.945133 13645 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:06.946313 13634 server_base.cc:1034] running on GCE node
I20260805 23:05:06.947119 13634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:06.948508 13634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:06.949802 13634 hybrid_clock.cc:648] HybridClock initialized: now 1785971106949761 us; error 54 us; skew 500 ppm
I20260805 23:05:06.950169 13634 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:06 dist-test-slave-1vmg krb5kdc[11720](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971106, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:06.953650 13634 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:05:06.955982 13634 webserver.cc:460] Webserver started at http://127.22.45.67:40237/ using document root <none> and password file <none>
I20260805 23:05:06.956812 13634 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:06.956936 13634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:06.963369 13634 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:05:06.966975 13654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:06.969137 13634 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:05:06.969372 13634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "02dcfe2488ea4b10b8ccb321eb7c6fe2"
format_stamp: "Formatted at 2026-08-05 23:04:20 on dist-test-slave-1vmg"
server_key: "ad1470e8dbdf2849127bf3359ee6fc63"
server_key_iv: "d9f1e17da71ea2822eca0de522579860"
server_key_version: "encryptionkey@0"
I20260805 23:05:06.970615 13634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:07.004621 13634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:07.009733 13634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:07.010042 13634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:07.011299 13634 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:07.012873 13634 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:07.012975 13634 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:07.013106 13634 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:07.013173 13634 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:07.047201 13790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:07.046273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:35959)
0805 23:05:07.046755 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:07.046872 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":229,"threads_started":1}
I20260805 23:05:07.048280 13634 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:46371
I20260805 23:05:07.048341 13797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:46371 every 8 connection(s)
I20260805 23:05:07.049757 13634 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:05:07.051810 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 13634
I20260805 23:05:07.055274 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:07.053201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:56371)
0805 23:05:07.054018 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:07.054286 (+ 268us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":311,"threads_started":1}
W20260805 23:05:07.056046 13798 heartbeater.cc:644] Failed to heartbeat to 127.22.45.126:35221 (0 consecutive failures): Network error: Failed to ping master at 127.22.45.126:35221: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
I20260805 23:05:07.056910 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:07.056573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:50453)
0805 23:05:07.056708 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:07.056781 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260805 23:05:07.057745 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:07.057432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:51293)
0805 23:05:07.057554 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:07.057630 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260805 23:05:07.058017 13798 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260805 23:05:07.553324 13804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:07.552372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:50431)
0805 23:05:07.552928 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:07.553040 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":269,"threads_started":1}
I20260805 23:05:08.049086 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:08.048189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:48451)
0805 23:05:08.048747 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:08.048864 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":252,"threads_started":1}
I20260805 23:05:08.059559 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:08.058607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:42731)
0805 23:05:08.059212 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:08.059309 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":351,"threads_started":1}
I20260805 23:05:08.555341 13808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:08.554433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:50929)
0805 23:05:08.555030 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:08.555148 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":275,"threads_started":1}
I20260805 23:05:09.051039 13810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:09.050245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:51483)
0805 23:05:09.050726 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:09.050821 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":239,"threads_started":1}
I20260805 23:05:09.061461 13812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:09.060659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:52269)
0805 23:05:09.061173 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:09.061272 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":247,"threads_started":1}
I20260805 23:05:09.557268 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:09.556409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:52893)
0805 23:05:09.556948 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:09.557048 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":298,"threads_started":1}
I20260805 23:05:10.052840 13815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:10.052051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:37167)
0805 23:05:10.052534 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:10.052628 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":238,"threads_started":1}
I20260805 23:05:10.063293 13816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:10.062463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:43579)
0805 23:05:10.063003 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:10.063103 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":249,"threads_started":1}
I20260805 23:05:10.559278 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:10.558350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:36423)
0805 23:05:10.558954 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:10.559070 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":311,"threads_started":1}
I20260805 23:05:11.054661 13818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:11.053871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:33549)
0805 23:05:11.054390 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:11.054484 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":268,"threads_started":1}
I20260805 23:05:11.065037 13819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:11.064260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:34625)
0805 23:05:11.064754 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:11.064849 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":242,"threads_started":1}
I20260805 23:05:11.561043 13820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:11.560220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:35307)
0805 23:05:11.560759 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:11.560852 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":275,"threads_started":1}
I20260805 23:05:12.056401 13821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:12.055607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:34487)
0805 23:05:12.056119 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:12.056233 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":269,"threads_started":1}
I20260805 23:05:12.066804 13823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:12.066028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:48331)
0805 23:05:12.066531 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:12.066625 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":259,"threads_started":1}
I20260805 23:05:12.562839 13824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:12.562078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:53523)
0805 23:05:12.562544 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:12.562648 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":237,"threads_started":1}
I20260805 23:05:13.058329 13826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:13.057458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:49237)
0805 23:05:13.057989 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:13.058092 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":233,"threads_started":1}
I20260805 23:05:13.068676 13827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:13.067822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:54471)
0805 23:05:13.068366 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:13.068473 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":288,"threads_started":1}
I20260805 23:05:13.564973 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:13.564019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:38761)
0805 23:05:13.564631 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:13.564733 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":280,"threads_started":1}
I20260805 23:05:14.060391 13829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:14.059461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:43725)
0805 23:05:14.060023 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:14.060157 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":277,"threads_started":1}
I20260805 23:05:14.070793 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:14.069856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:49265)
0805 23:05:14.070440 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:14.070546 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":273,"threads_started":1}
I20260805 23:05:14.567009 13833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:14.566079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:58889)
0805 23:05:14.566661 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:14.566771 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":310,"threads_started":1}
I20260805 23:05:15.062304 13834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:15.061426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:40683)
0805 23:05:15.061993 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:15.062095 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":275,"threads_started":1}
I20260805 23:05:15.073350 13835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:15.072316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:45519)
0805 23:05:15.072969 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:15.073102 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":322,"threads_started":1}
I20260805 23:05:15.568769 13836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:15.567982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:58067)
0805 23:05:15.568480 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:15.568573 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":240,"threads_started":1}
I20260805 23:05:16.064227 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:16.063424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:42447)
0805 23:05:16.063943 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:16.064046 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":272,"threads_started":1}
I20260805 23:05:16.075562 13840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:16.074644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:54899)
0805 23:05:16.075188 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:16.075309 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":272,"threads_started":1}
I20260805 23:05:16.570827 13841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:16.569910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:60571)
0805 23:05:16.570532 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:16.570640 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":402,"threads_started":1}
I20260805 23:05:17.066314 13843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:17.065355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:37989)
0805 23:05:17.065967 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:17.066108 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":336,"threads_started":1}
I20260805 23:05:17.077374 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:17.076542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:58683)
0805 23:05:17.077043 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:17.077179 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":279,"threads_started":1}
I20260805 23:05:17.572618 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:17.571838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:43655)
0805 23:05:17.572313 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:17.572425 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":238,"threads_started":1}
I20260805 23:05:18.068454 13847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:18.067621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:36105)
0805 23:05:18.068179 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:18.068281 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":279,"threads_started":1}
I20260805 23:05:18.079381 13849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:18.078440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:36867)
0805 23:05:18.079065 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:18.079183 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":323,"threads_started":1}
I20260805 23:05:18.574414 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:18.573645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:58503)
0805 23:05:18.574148 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:18.574244 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":225,"threads_started":1}
I20260805 23:05:19.070720 13853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:19.069655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:51785)
0805 23:05:19.070292 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:19.070475 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":295,"threads_started":1}
I20260805 23:05:19.081130 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:19.080365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:38743)
0805 23:05:19.080870 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:19.080959 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":269,"threads_started":1}
I20260805 23:05:19.576490 13855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:19.575519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:47785)
0805 23:05:19.576109 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:19.576234 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":317,"threads_started":1}
I20260805 23:05:20.072567 13856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:20.071801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:51137)
0805 23:05:20.072276 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:20.072369 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":234,"threads_started":1}
I20260805 23:05:20.083081 13858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:20.082123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:59441)
0805 23:05:20.082728 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:20.082837 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":323,"threads_started":1}
I20260805 23:05:20.578497 13859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:20.577624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:52545)
0805 23:05:20.578171 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:20.578287 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":268,"threads_started":1}
I20260805 23:05:21.074543 13862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:21.073766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:40745)
0805 23:05:21.074237 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:21.074338 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":235,"threads_started":1}
I20260805 23:05:21.084789 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:21.084039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:37941)
0805 23:05:21.084497 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:21.084584 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":239,"threads_started":1}
I20260805 23:05:21.580837 13865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:21.579996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.66:38857)
0805 23:05:21.580490 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:21.580623 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":251,"threads_started":1}
I20260805 23:05:22.061815 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 13227
I20260805 23:05:22.076709 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:22.075688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.65:58931)
0805 23:05:22.076261 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:22.076456 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":285,"threads_started":1}
I20260805 23:05:22.087014 13868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:22.086115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35221 (local address 127.22.45.67:58693)
0805 23:05:22.086657 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:22.086761 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.126:35221: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":281,"threads_started":1}
I20260805 23:05:22.091387 13866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:22.063304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42562 (local address 127.22.45.65:43625)
0805 23:05:22.063997 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:22.064019 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:22.064071 (+ 52us) server_negotiation.cc:407] Connection header received
0805 23:05:22.065704 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:22.065716 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:22.066231 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:22.066559 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:22.068189 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:22.069540 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:22.071071 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:22.071902 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:22.072070 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:22.084126 (+ 12056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:22.084138 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:22.084159 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:22.084219 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:22.087893 (+ 3674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:22.088797 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:22.088806 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:22.088815 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:22.089008 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:22.089373 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:22.089376 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:22.089377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:22.089981 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:22.090241 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:22.090620 (+ 379us) server_negotiation.cc:299] Negotiation successful
0805 23:05:22.091072 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":319,"threads_started":1}
I20260805 23:05:22.092993 13448 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:22.179867 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 13227
I20260805 23:05:22.205367 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 13458
I20260805 23:05:22.223709 13870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:22.206347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47768 (local address 127.22.45.66:44341)
0805 23:05:22.206888 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:22.206903 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:22.206984 (+ 81us) server_negotiation.cc:407] Connection header received
0805 23:05:22.208564 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:22.208576 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:22.209040 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:22.209369 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:22.210783 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:22.212148 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:22.213518 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:22.214247 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:22.214399 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:22.217161 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:22.217170 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:22.217198 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:22.217241 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:22.220330 (+ 3089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:22.221123 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:22.221131 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:22.221139 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:22.221353 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:22.221660 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:22.221663 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:22.221665 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:22.222255 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:22.222507 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:22.222879 (+ 372us) server_negotiation.cc:299] Negotiation successful
0805 23:05:22.223401 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":245,"threads_started":1}
I20260805 23:05:22.225270 13622 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:22.333220 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 13458
I20260805 23:05:22.356508 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 13634
I20260805 23:05:22.375963 13872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:22.357638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50564 (local address 127.22.45.67:46371)
0805 23:05:22.358261 (+ 623us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:22.358278 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:22.358325 (+ 47us) server_negotiation.cc:407] Connection header received
0805 23:05:22.360138 (+ 1813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:22.360151 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:22.360647 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:22.360976 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:22.362412 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:22.363897 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:22.365287 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:22.366031 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:22.366217 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:22.369154 (+ 2937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:22.369165 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:22.369186 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:22.369245 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:22.372502 (+ 3257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:22.373254 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:22.373261 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:22.373269 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:22.373464 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:22.373774 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:22.373777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:22.373779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:22.374388 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:22.374625 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:22.375125 (+ 500us) server_negotiation.cc:299] Negotiation successful
0805 23:05:22.375589 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":277,"threads_started":1}
I20260805 23:05:22.377440 13789 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:22.461038 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 13634
2026-08-05T23:05:22Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (66496 ms)
[----------] 30 tests from SecurityITest (317872 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:22 dist-test-slave-1vmg krb5kdc[13876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:22 dist-test-slave-1vmg krb5kdc[13876](info): set up 2 sockets
Aug 05 23:05:22 dist-test-slave-1vmg krb5kdc[13876](info): commencing operation
krb5kdc: starting...
W20260805 23:05:23.665773 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.159s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:23 dist-test-slave-1vmg krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:05:23.979619 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:42505
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:42505
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:24.337574 13894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:24.337952 13894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:24.338099 13894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:24.345916 13894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:24.346077 13894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:24.346164 13894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:24.346247 13894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:24.346309 13894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:24.356766 13894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:42505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:42505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:24.358260 13894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:24.359786 13894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:24.372385 13903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:24.372466 13900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:24.372454 13901 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:24.373356 13894 server_base.cc:1034] running on GCE node
I20260805 23:05:24.374240 13894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:24.375849 13894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:24.377079 13894 hybrid_clock.cc:648] HybridClock initialized: now 1785971124377029 us; error 53 us; skew 500 ppm
I20260805 23:05:24.377449 13894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:24 dist-test-slave-1vmg krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971124, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:24.384033 13894 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:05:24.385799 13894 webserver.cc:460] Webserver started at http://127.22.45.126:43021/ using document root <none> and password file <none>
I20260805 23:05:24.386543 13894 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:24.386683 13894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:24.387058 13894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:24.390316 13894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "750e6950cf7f463cb3964a876c6e6825"
format_stamp: "Formatted at 2026-08-05 23:05:24 on dist-test-slave-1vmg"
server_key: "fd767507ec83d75e630e328c6894c27f"
server_key_iv: "0f111e31b91210bd8b3b4b2a1aac05e4"
server_key_version: "encryptionkey@0"
I20260805 23:05:24.391202 13894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "750e6950cf7f463cb3964a876c6e6825"
format_stamp: "Formatted at 2026-08-05 23:05:24 on dist-test-slave-1vmg"
server_key: "fd767507ec83d75e630e328c6894c27f"
server_key_iv: "0f111e31b91210bd8b3b4b2a1aac05e4"
server_key_version: "encryptionkey@0"
I20260805 23:05:24.396792 13894 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:05:24.400489 13916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:24.401896 13894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 23:05:24.402076 13894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "750e6950cf7f463cb3964a876c6e6825"
format_stamp: "Formatted at 2026-08-05 23:05:24 on dist-test-slave-1vmg"
server_key: "fd767507ec83d75e630e328c6894c27f"
server_key_iv: "0f111e31b91210bd8b3b4b2a1aac05e4"
server_key_version: "encryptionkey@0"
I20260805 23:05:24.402279 13894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:24.417536 13894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:24.421980 13894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:24.422281 13894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:24.440873 13894 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:42505
I20260805 23:05:24.440905 13998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:42505 every 8 connection(s)
I20260805 23:05:24.442387 13894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:24.446558 13999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:24.450511 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 13894
I20260805 23:05:24.450775 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:24.451706 22709 external_mini_cluster.cc:1428] Setting key d75c5f2dc6a9fd74492418a642bee855
I20260805 23:05:24.461223 13999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825: Bootstrap starting.
I20260805 23:05:24.465487 13999 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:24.466972 13999 log.cc:824] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825: Log is configured to *not* fsync() on all Append() calls
Aug 05 23:05:24 dist-test-slave-1vmg krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:24.470371 13999 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825: No bootstrap required, opened a new log
I20260805 23:05:24.476856 14002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:24.454020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44152 (local address 127.22.45.126:42505)
0805 23:05:24.454881 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:24.454894 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:24.454974 (+ 80us) server_negotiation.cc:407] Connection header received
0805 23:05:24.456693 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:24.456717 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:24.457186 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:24.457545 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:24.459514 (+ 1969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:24.460893 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:24.462708 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:24.463497 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:24.463668 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:24.468946 (+ 5278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:24.468955 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:24.468972 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:24.469011 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:24.472200 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:24.473140 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:24.473148 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:24.473155 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:24.473351 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:24.473765 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:24.473768 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:24.473770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:24.474387 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:24.474632 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:24.475181 (+ 549us) server_negotiation.cc:299] Negotiation successful
0805 23:05:24.475638 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":400,"threads_started":1}
I20260805 23:05:24.480090 13999 raft_consensus.cc:348] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750e6950cf7f463cb3964a876c6e6825" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42505 } }
I20260805 23:05:24.480558 13999 raft_consensus.cc:374] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:24.480659 13999 raft_consensus.cc:729] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 750e6950cf7f463cb3964a876c6e6825, State: Initialized, Role: FOLLOWER
I20260805 23:05:24.481215 13999 consensus_queue.cc:260] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750e6950cf7f463cb3964a876c6e6825" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42505 } }
I20260805 23:05:24.481446 13999 raft_consensus.cc:388] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:24.481585 13999 raft_consensus.cc:482] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:24.481745 13999 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:24.484264 13999 raft_consensus.cc:504] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750e6950cf7f463cb3964a876c6e6825" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42505 } }
I20260805 23:05:24.484823 13999 leader_election.cc:302] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 750e6950cf7f463cb3964a876c6e6825; no voters:
I20260805 23:05:24.485409 13999 leader_election.cc:288] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:24.485536 14005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:24.486240 14005 raft_consensus.cc:686] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [term 1 LEADER]: Becoming Leader. State: Replica: 750e6950cf7f463cb3964a876c6e6825, State: Running, Role: LEADER
I20260805 23:05:24.486824 14005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750e6950cf7f463cb3964a876c6e6825" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42505 } }
I20260805 23:05:24.487537 13999 sys_catalog.cc:564] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:24.489500 14006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "750e6950cf7f463cb3964a876c6e6825" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750e6950cf7f463cb3964a876c6e6825" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42505 } } }
I20260805 23:05:24.489878 14006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:24.491007 14012 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:24.490842 14007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 750e6950cf7f463cb3964a876c6e6825. Latest consensus state: current_term: 1 leader_uuid: "750e6950cf7f463cb3964a876c6e6825" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "750e6950cf7f463cb3964a876c6e6825" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42505 } } }
I20260805 23:05:24.491251 14007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:24.500833 14012 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:24.511123 14012 catalog_manager.cc:1347] Generated new cluster ID: 4270139f6f0a44c2b00721c0f30e8b4a
I20260805 23:05:24.511505 14012 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:24.520030 14012 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:24.521906 14012 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:24.531531 14012 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825: Generated new TSK 0
I20260805 23:05:24.532472 14012 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:05:24.607893 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42505
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:24.978731 14030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:24.979104 14030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:24.979223 14030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:24.986800 14030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:24.986997 14030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:24.987172 14030 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:05:24.998176 14030 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:24.999747 14030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:25.001176 14030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:25.018182 14037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:25.018443 14036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:25.019032 14039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:25.019526 14030 server_base.cc:1034] running on GCE node
I20260805 23:05:25.020282 14030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:25.021379 14030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:25.022617 14030 hybrid_clock.cc:648] HybridClock initialized: now 1785971125022552 us; error 59 us; skew 500 ppm
I20260805 23:05:25.023000 14030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:25 dist-test-slave-1vmg krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971125, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:25.026456 14030 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:05:25.028126 14030 webserver.cc:460] Webserver started at http://127.22.45.65:46685/ using document root <none> and password file <none>
I20260805 23:05:25.028880 14030 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:25.029008 14030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:25.029348 14030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:25.032518 14030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "ef741ed37a4d4ea1974cc07469887298"
format_stamp: "Formatted at 2026-08-05 23:05:25 on dist-test-slave-1vmg"
server_key: "e83fd0f96a241e3a083a1d183585494c"
server_key_iv: "07957947d5d1fad00165e83c11990959"
server_key_version: "encryptionkey@0"
I20260805 23:05:25.033365 14030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "ef741ed37a4d4ea1974cc07469887298"
format_stamp: "Formatted at 2026-08-05 23:05:25 on dist-test-slave-1vmg"
server_key: "e83fd0f96a241e3a083a1d183585494c"
server_key_iv: "07957947d5d1fad00165e83c11990959"
server_key_version: "encryptionkey@0"
I20260805 23:05:25.039204 14030 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260805 23:05:25.043174 14047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:25.044709 14030 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:05:25.044920 14030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "ef741ed37a4d4ea1974cc07469887298"
format_stamp: "Formatted at 2026-08-05 23:05:25 on dist-test-slave-1vmg"
server_key: "e83fd0f96a241e3a083a1d183585494c"
server_key_iv: "07957947d5d1fad00165e83c11990959"
server_key_version: "encryptionkey@0"
I20260805 23:05:25.045184 14030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:25.060696 14030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:25.065397 14030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:25.065716 14030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:25.066783 14030 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:25.068305 14030 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:25.068389 14030 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:25.068528 14030 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:25.068588 14030 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:25.101922 14030 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:35905
I20260805 23:05:25.101970 14185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:35905 every 8 connection(s)
I20260805 23:05:25.103372 14030 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:05:25.111099 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 14030
I20260805 23:05:25.111359 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:05:25.112272 22709 external_mini_cluster.cc:1428] Setting key c215fad3400e3410221037321faf6366
Aug 05 23:05:25 dist-test-slave-1vmg krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971125, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:25.127569 14189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:25.106215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:45409 (local address 127.22.45.126:42505)
0805 23:05:25.106760 (+ 545us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:25.106765 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:25.107902 (+ 1137us) server_negotiation.cc:407] Connection header received
0805 23:05:25.109856 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:25.109861 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:25.109940 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:25.110048 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:25.112464 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.113471 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.115898 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.116354 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.116471 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:25.121147 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:25.121153 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:25.121157 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:25.121199 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:25.124073 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:25.125010 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:25.125015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:25.125018 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:25.125163 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:25.125649 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:25.125653 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:25.125655 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:25.125946 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:25.126091 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:25.126895 (+ 804us) server_negotiation.cc:299] Negotiation successful
0805 23:05:25.127205 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":298,"threads_started":1}
I20260805 23:05:25.128923 14190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:25.106865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:42505 (local address 127.22.45.65:45409)
0805 23:05:25.107711 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:25.107762 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:25.109531 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:25.110286 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:25.110296 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:25.111157 (+ 861us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:25.112130 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:25.112161 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.113695 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.113701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:25.115679 (+ 1978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:25.115699 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.116627 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.116634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:25.116959 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:25.117769 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:25.117799 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:25.120790 (+ 2991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:25.124314 (+ 3524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:25.124323 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:25.124341 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:25.124854 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:25.125292 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:25.125297 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:25.125301 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:25.125519 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:25.126083 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:25.126092 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:25.126477 (+ 385us) client_negotiation.cc:769] Sending connection context
0805 23:05:25.126739 (+ 262us) client_negotiation.cc:240] Negotiation successful
0805 23:05:25.127368 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":340,"threads_started":1}
I20260805 23:05:25.130679 14187 heartbeater.cc:347] Connected to a master server at 127.22.45.126:42505
I20260805 23:05:25.131078 14187 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:25.132061 14187 heartbeater.cc:511] Master 127.22.45.126:42505 requested a full tablet report, sending...
I20260805 23:05:25.134647 13946 ts_manager.cc:194] Registered new tserver with Master: ef741ed37a4d4ea1974cc07469887298 (127.22.45.65:35905)
I20260805 23:05:25.136768 13946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:45409
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:05:25.186503 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42505
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:25.544122 14193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:25.544438 14193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:25.544564 14193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:25.552327 14193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:25.552474 14193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:25.552627 14193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:05:25.563256 14193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:25.564718 14193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:25.566154 14193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:25.580021 14201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:25.579877 14204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:25.579907 14202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:25.581090 14193 server_base.cc:1034] running on GCE node
I20260805 23:05:25.581745 14193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:25.582756 14193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:25.583952 14193 hybrid_clock.cc:648] HybridClock initialized: now 1785971125583897 us; error 76 us; skew 500 ppm
I20260805 23:05:25.584280 14193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:25 dist-test-slave-1vmg krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971125, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:25.587600 14193 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:05:25.589140 14193 webserver.cc:460] Webserver started at http://127.22.45.66:41125/ using document root <none> and password file <none>
I20260805 23:05:25.589859 14193 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:25.589965 14193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:25.590256 14193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:25.593395 14193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "8dd9394121d94a2f999a5588c2007ae7"
format_stamp: "Formatted at 2026-08-05 23:05:25 on dist-test-slave-1vmg"
server_key: "836a17fc2f632845d016bc84f955da82"
server_key_iv: "7f2eaf8c1580a0cd63f9fbb827f000b4"
server_key_version: "encryptionkey@0"
I20260805 23:05:25.594208 14193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "8dd9394121d94a2f999a5588c2007ae7"
format_stamp: "Formatted at 2026-08-05 23:05:25 on dist-test-slave-1vmg"
server_key: "836a17fc2f632845d016bc84f955da82"
server_key_iv: "7f2eaf8c1580a0cd63f9fbb827f000b4"
server_key_version: "encryptionkey@0"
I20260805 23:05:25.599606 14193 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260805 23:05:25.603223 14213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:25.604604 14193 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:05:25.604768 14193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "8dd9394121d94a2f999a5588c2007ae7"
format_stamp: "Formatted at 2026-08-05 23:05:25 on dist-test-slave-1vmg"
server_key: "836a17fc2f632845d016bc84f955da82"
server_key_iv: "7f2eaf8c1580a0cd63f9fbb827f000b4"
server_key_version: "encryptionkey@0"
I20260805 23:05:25.604964 14193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:25.624320 14193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:25.629000 14193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:25.629299 14193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:25.630312 14193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:25.631811 14193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:25.631891 14193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:25.632001 14193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:25.632052 14193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:25.665520 14193 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:44533
I20260805 23:05:25.665562 14365 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:44533 every 8 connection(s)
I20260805 23:05:25.666898 14193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:05:25.672384 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 14193
I20260805 23:05:25.672713 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:05:25.673240 22709 external_mini_cluster.cc:1428] Setting key a9403dd60549026ffa3c96aed37ff0a8
Aug 05 23:05:25 dist-test-slave-1vmg krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971125, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:25.691668 14370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:25.669715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:48851 (local address 127.22.45.126:42505)
0805 23:05:25.670222 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:25.670229 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:25.671439 (+ 1210us) server_negotiation.cc:407] Connection header received
0805 23:05:25.673525 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:25.673531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:25.673631 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:25.673775 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:25.675882 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.676951 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.678870 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.679497 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.679628 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:25.683610 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:25.683617 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:25.683622 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:25.683667 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:25.687193 (+ 3526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:25.688822 (+ 1629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:25.688827 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:25.688829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:25.689035 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:25.689685 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:25.689689 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:25.689691 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:25.690010 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:25.690144 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:25.691160 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0805 23:05:25.691371 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":258,"threads_started":1}
I20260805 23:05:25.693301 14371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:25.670303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:42505 (local address 127.22.45.66:48851)
0805 23:05:25.671245 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:25.671297 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:25.673168 (+ 1871us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:25.674147 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:25.674162 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:25.674805 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:25.675673 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:25.675700 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.677174 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.677178 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:25.678700 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:25.678715 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:25.679790 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:25.679796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:25.680025 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:25.680768 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:25.680800 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:25.683310 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:25.687495 (+ 4185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:25.687508 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:25.687531 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:25.688647 (+ 1116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:25.689172 (+ 525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:25.689177 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:25.689181 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:25.689533 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:25.690153 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:25.690162 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:25.690664 (+ 502us) client_negotiation.cc:769] Sending connection context
0805 23:05:25.691045 (+ 381us) client_negotiation.cc:240] Negotiation successful
0805 23:05:25.691665 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":392,"threads_started":1}
I20260805 23:05:25.695397 14366 heartbeater.cc:347] Connected to a master server at 127.22.45.126:42505
I20260805 23:05:25.695755 14366 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:25.696707 14366 heartbeater.cc:511] Master 127.22.45.126:42505 requested a full tablet report, sending...
I20260805 23:05:25.698479 13946 ts_manager.cc:194] Registered new tserver with Master: 8dd9394121d94a2f999a5588c2007ae7 (127.22.45.66:44533)
I20260805 23:05:25.699435 13946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:48851
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:05:25.741689 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42505
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:26.099444 14376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:26.099797 14376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:26.099931 14376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:26.107674 14376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:26.107798 14376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:26.107914 14376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:05:26.118129 14376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42505
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:26.119661 14376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:26.121038 14376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:26.135030 14386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:26.135205 14383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:26.135246 14388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:26.136955 14376 server_base.cc:1034] running on GCE node
I20260805 23:05:26.137603 14376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:26.138764 14376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:26.140029 14376 hybrid_clock.cc:648] HybridClock initialized: now 1785971126139956 us; error 68 us; skew 500 ppm
I20260805 23:05:26.140410 14376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:26.141155 14187 heartbeater.cc:503] Master 127.22.45.126:42505 was elected leader, sending a full tablet report...
Aug 05 23:05:26 dist-test-slave-1vmg krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971126, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:26.144212 14376 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:05:26.145862 14376 webserver.cc:460] Webserver started at http://127.22.45.67:39911/ using document root <none> and password file <none>
I20260805 23:05:26.146647 14376 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:26.146788 14376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:26.147212 14376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:26.150687 14376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "d94fdc0d65fa409b82f7d2aa381434ca"
format_stamp: "Formatted at 2026-08-05 23:05:26 on dist-test-slave-1vmg"
server_key: "cb877b4a376a00c7c586083be79004d6"
server_key_iv: "fe5071e55593b010395f1fed8e2a9da5"
server_key_version: "encryptionkey@0"
I20260805 23:05:26.151585 14376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "d94fdc0d65fa409b82f7d2aa381434ca"
format_stamp: "Formatted at 2026-08-05 23:05:26 on dist-test-slave-1vmg"
server_key: "cb877b4a376a00c7c586083be79004d6"
server_key_iv: "fe5071e55593b010395f1fed8e2a9da5"
server_key_version: "encryptionkey@0"
I20260805 23:05:26.157617 14376 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:05:26.162256 14399 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:26.163923 14376 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:05:26.164139 14376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "d94fdc0d65fa409b82f7d2aa381434ca"
format_stamp: "Formatted at 2026-08-05 23:05:26 on dist-test-slave-1vmg"
server_key: "cb877b4a376a00c7c586083be79004d6"
server_key_iv: "fe5071e55593b010395f1fed8e2a9da5"
server_key_version: "encryptionkey@0"
I20260805 23:05:26.164371 14376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:26.183329 14376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:26.188334 14376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:26.188643 14376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:26.189757 14376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:26.191325 14376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:26.191412 14376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:26.191547 14376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:26.191602 14376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:26.226778 14376 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:36285
I20260805 23:05:26.226828 14558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:36285 every 8 connection(s)
I20260805 23:05:26.228309 14376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:05:26.233624 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 14376
I20260805 23:05:26.233804 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:05:26.234265 22709 external_mini_cluster.cc:1428] Setting key e1ad51601d402aedefac2211cdba2efc
Aug 05 23:05:26 dist-test-slave-1vmg krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971126, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:26.251317 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.231453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:59709 (local address 127.22.45.126:42505)
0805 23:05:26.231952 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.231957 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.233086 (+ 1129us) server_negotiation.cc:407] Connection header received
0805 23:05:26.235445 (+ 2359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.235451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.235542 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.235665 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:26.237783 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.238590 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.240300 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.240755 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.240870 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.244603 (+ 3733us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:26.244609 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:26.244612 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:26.244681 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:26.247632 (+ 2951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.248541 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.248546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.248548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.248715 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.249286 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.249292 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.249295 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.249727 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:26.249945 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.250782 (+ 837us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.251028 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":237,"threads_started":1}
I20260805 23:05:26.252282 14565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.232021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:42505 (local address 127.22.45.67:59709)
0805 23:05:26.232875 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:26.232922 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:26.235058 (+ 2136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:26.235994 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:26.236008 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:26.236854 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:26.237598 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.237622 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.238730 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.238733 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.240133 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.240148 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.240997 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.241002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.241230 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.241950 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:26.241975 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:26.244343 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:26.247806 (+ 3463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:26.247815 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:26.247832 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:26.248352 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:26.248837 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:26.248843 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:26.248847 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:26.249130 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:26.249920 (+ 790us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:26.249929 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:26.250412 (+ 483us) client_negotiation.cc:769] Sending connection context
0805 23:05:26.250659 (+ 247us) client_negotiation.cc:240] Negotiation successful
0805 23:05:26.251145 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":325,"threads_started":1}
I20260805 23:05:26.253778 14560 heartbeater.cc:347] Connected to a master server at 127.22.45.126:42505
I20260805 23:05:26.254096 14560 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:26.254882 14560 heartbeater.cc:511] Master 127.22.45.126:42505 requested a full tablet report, sending...
I20260805 23:05:26.256532 13946 ts_manager.cc:194] Registered new tserver with Master: d94fdc0d65fa409b82f7d2aa381434ca (127.22.45.67:36285)
I20260805 23:05:26.257364 13946 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:59709
I20260805 23:05:26.262741 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:05:26.282013 14564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.267730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53952 (local address 127.22.45.126:42505)
0805 23:05:26.268000 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.268007 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.268328 (+ 321us) server_negotiation.cc:407] Connection header received
0805 23:05:26.268512 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.268516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.268588 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.268679 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:26.270346 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.271158 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.272588 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.273065 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.273189 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.275965 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:26.275971 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:26.275975 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:26.276023 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:26.278800 (+ 2777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.279745 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.279750 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.279753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.279914 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.280344 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.280349 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.280351 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.280739 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:26.281000 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.281398 (+ 398us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.281689 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 23:05:26.287811 13946 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53952:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:05:26.295502 13946 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:05:26.335345 14578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.310988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:35905 (local address 127.0.0.1:46474)
0805 23:05:26.312141 (+ 1153us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:26.312161 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:26.312301 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:26.323812 (+ 11511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:26.323822 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:26.323869 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:26.324396 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.324410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.327106 (+ 2696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.327113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.331369 (+ 4256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.331397 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.333781 (+ 2384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.333791 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.334044 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.334118 (+ 74us) client_negotiation.cc:769] Sending connection context
0805 23:05:26.334233 (+ 115us) client_negotiation.cc:240] Negotiation successful
0805 23:05:26.334466 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1034,"thread_start_us":884,"threads_started":1}
I20260805 23:05:26.336877 14579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.311551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46474 (local address 127.22.45.65:35905)
0805 23:05:26.322522 (+ 10971us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.322533 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.322581 (+ 48us) server_negotiation.cc:407] Connection header received
0805 23:05:26.322751 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.322761 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.323155 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.324659 (+ 1504us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:26.324936 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.326858 (+ 1922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.331693 (+ 4835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.333495 (+ 1802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.334681 (+ 1186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.336112 (+ 1431us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.336365 (+ 253us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.336619 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10710,"thread_start_us":11854,"threads_started":1}
I20260805 23:05:26.341109 14106 tablet_service.cc:1467] Processing CreateTablet for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 (DEFAULT_TABLE table=test-table [id=429682bf162f4ebd81dde80dc11e6b86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:26.341972 14576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.310720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:44533 (local address 127.0.0.1:36086)
0805 23:05:26.311565 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:26.311625 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:26.311824 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:26.334788 (+ 22964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:26.334794 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:26.334829 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:26.335595 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.335612 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.337777 (+ 2165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.337783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.339426 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.339441 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.341085 (+ 1644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.341093 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.341264 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.341300 (+ 36us) client_negotiation.cc:769] Sending connection context
0805 23:05:26.341399 (+ 99us) client_negotiation.cc:240] Negotiation successful
0805 23:05:26.341549 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"mutex_wait_us":26,"thread_start_us":352,"threads_started":1}
I20260805 23:05:26.342021 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.310965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36086 (local address 127.22.45.66:44533)
0805 23:05:26.334041 (+ 23076us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.334049 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.334077 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:05:26.334183 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.334190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.334416 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.334963 (+ 547us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:26.335804 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.337592 (+ 1788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.339599 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.340835 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.340983 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.341197 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.341492 (+ 295us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.341666 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22912,"thread_start_us":22755,"threads_started":1}
I20260805 23:05:26.343056 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.314699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53776 (local address 127.22.45.67:36285)
0805 23:05:26.333683 (+ 18984us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.333696 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.333746 (+ 50us) server_negotiation.cc:407] Connection header received
0805 23:05:26.333861 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.333869 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.334122 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.334334 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:26.335939 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.337630 (+ 1691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.340252 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.341585 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.341723 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.341946 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.342488 (+ 542us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.342661 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18776,"thread_start_us":18585,"threads_started":1}
I20260805 23:05:26.343475 14106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:26.343818 14580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.314429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:36285 (local address 127.0.0.1:53776)
0805 23:05:26.332528 (+ 18099us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:26.332553 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:26.332735 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:26.334340 (+ 1605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:26.334345 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:26.334375 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:26.335686 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.335714 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.337811 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.337816 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.340051 (+ 2235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.340068 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.342100 (+ 2032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.342107 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.342271 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.342305 (+ 34us) client_negotiation.cc:769] Sending connection context
0805 23:05:26.342386 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 23:05:26.342523 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17921,"mutex_wait_us":2,"thread_start_us":18404,"threads_started":1}
I20260805 23:05:26.346645 14282 tablet_service.cc:1467] Processing CreateTablet for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 (DEFAULT_TABLE table=test-table [id=429682bf162f4ebd81dde80dc11e6b86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:26.348372 14282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:26.351449 14459 tablet_service.cc:1467] Processing CreateTablet for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 (DEFAULT_TABLE table=test-table [id=429682bf162f4ebd81dde80dc11e6b86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:26.353076 14459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:26.366659 14582 tablet_bootstrap.cc:492] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Bootstrap starting.
I20260805 23:05:26.372059 14583 tablet_bootstrap.cc:492] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Bootstrap starting.
I20260805 23:05:26.375062 14582 tablet_bootstrap.cc:654] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:26.377036 14583 tablet_bootstrap.cc:654] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:26.377091 14582 log.cc:824] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:26.378859 14583 log.cc:824] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:26.380900 14584 tablet_bootstrap.cc:492] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Bootstrap starting.
I20260805 23:05:26.385179 14584 tablet_bootstrap.cc:654] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:26.386300 14584 log.cc:824] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:26.390242 14583 tablet_bootstrap.cc:492] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: No bootstrap required, opened a new log
I20260805 23:05:26.390733 14583 ts_tablet_manager.cc:1397] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.000s
I20260805 23:05:26.396528 14584 tablet_bootstrap.cc:492] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: No bootstrap required, opened a new log
I20260805 23:05:26.397044 14584 ts_tablet_manager.cc:1397] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20260805 23:05:26.401655 14582 tablet_bootstrap.cc:492] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: No bootstrap required, opened a new log
I20260805 23:05:26.402107 14582 ts_tablet_manager.cc:1397] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Time spent bootstrapping tablet: real 0.036s user 0.008s sys 0.021s
I20260805 23:05:26.405194 14583 raft_consensus.cc:348] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.405900 14583 raft_consensus.cc:374] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:26.406101 14583 raft_consensus.cc:729] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dd9394121d94a2f999a5588c2007ae7, State: Initialized, Role: FOLLOWER
I20260805 23:05:26.407130 14583 consensus_queue.cc:260] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.409173 14584 raft_consensus.cc:348] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.410006 14584 raft_consensus.cc:374] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:26.410176 14584 raft_consensus.cc:729] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d94fdc0d65fa409b82f7d2aa381434ca, State: Initialized, Role: FOLLOWER
I20260805 23:05:26.411303 14584 consensus_queue.cc:260] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.413405 14560 heartbeater.cc:503] Master 127.22.45.126:42505 was elected leader, sending a full tablet report...
I20260805 23:05:26.414067 14584 ts_tablet_manager.cc:1428] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Time spent starting tablet: real 0.017s user 0.011s sys 0.003s
I20260805 23:05:26.415323 14366 heartbeater.cc:503] Master 127.22.45.126:42505 was elected leader, sending a full tablet report...
I20260805 23:05:26.417831 14583 ts_tablet_manager.cc:1428] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Time spent starting tablet: real 0.027s user 0.011s sys 0.009s
I20260805 23:05:26.419157 14588 raft_consensus.cc:482] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260805 23:05:26.419417 14367 tablet.cc:2369] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:26.419560 14588 raft_consensus.cc:504] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.420092 14582 raft_consensus.cc:348] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.420611 14582 raft_consensus.cc:374] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:26.420715 14582 raft_consensus.cc:729] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef741ed37a4d4ea1974cc07469887298, State: Initialized, Role: FOLLOWER
I20260805 23:05:26.421510 14582 consensus_queue.cc:260] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.421842 14588 leader_election.cc:288] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef741ed37a4d4ea1974cc07469887298 (127.22.45.65:35905), d94fdc0d65fa409b82f7d2aa381434ca (127.22.45.67:36285)
I20260805 23:05:26.434146 14579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.422791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:39627 (local address 127.22.45.65:35905)
0805 23:05:26.423051 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.423057 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.425138 (+ 2081us) server_negotiation.cc:407] Connection header received
0805 23:05:26.425471 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.425479 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.425575 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.425684 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:26.426602 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.427966 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.431036 (+ 3070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.432530 (+ 1494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.432720 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.432815 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.433599 (+ 784us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.433795 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:05:26.435261 14591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.423215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:35905 (local address 127.22.45.66:39627)
0805 23:05:26.425008 (+ 1793us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:26.425033 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:26.425273 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:26.425900 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:26.425907 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:26.425940 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:26.426396 (+ 456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.426409 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.428215 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.428222 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.430730 (+ 2508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.430753 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.433126 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.433134 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.433367 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.433407 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 23:05:26.434527 (+ 1120us) client_negotiation.cc:240] Negotiation successful
0805 23:05:26.434739 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1650,"thread_start_us":1988,"threads_started":1}
I20260805 23:05:26.436944 14130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8eae6a96dd4655a2d8f9b2753c86f4" candidate_uuid: "8dd9394121d94a2f999a5588c2007ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef741ed37a4d4ea1974cc07469887298" is_pre_election: true
I20260805 23:05:26.437662 14130 raft_consensus.cc:2454] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd9394121d94a2f999a5588c2007ae7 in term 0.
I20260805 23:05:26.438715 14215 leader_election.cc:302] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd9394121d94a2f999a5588c2007ae7, ef741ed37a4d4ea1974cc07469887298; no voters:
I20260805 23:05:26.439358 14588 raft_consensus.cc:2781] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:05:26.439579 14588 raft_consensus.cc:482] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:05:26.439752 14588 raft_consensus.cc:3037] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:26.445917 14582 ts_tablet_manager.cc:1428] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Time spent starting tablet: real 0.044s user 0.031s sys 0.006s
I20260805 23:05:26.446537 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.422457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:45337 (local address 127.22.45.67:36285)
0805 23:05:26.422734 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.422742 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.436354 (+ 13612us) server_negotiation.cc:407] Connection header received
0805 23:05:26.436466 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.436473 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.436570 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.436679 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:26.437555 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.438831 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.443824 (+ 4993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.445109 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.445298 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.445388 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.446099 (+ 711us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.446280 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 23:05:26.447031 14592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.424929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:36285 (local address 127.22.45.66:45337)
0805 23:05:26.435628 (+ 10699us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:26.435648 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:26.435806 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:26.436893 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:26.436899 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:26.436935 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:26.437334 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.437347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.439100 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.439107 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.443467 (+ 4360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:26.443502 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.445649 (+ 2147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.445657 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:26.445866 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.445907 (+ 41us) client_negotiation.cc:769] Sending connection context
0805 23:05:26.446443 (+ 536us) client_negotiation.cc:240] Negotiation successful
0805 23:05:26.446613 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10552,"thread_start_us":10289,"threads_started":1}
I20260805 23:05:26.448511 14487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8eae6a96dd4655a2d8f9b2753c86f4" candidate_uuid: "8dd9394121d94a2f999a5588c2007ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" is_pre_election: true
I20260805 23:05:26.449126 14487 raft_consensus.cc:2454] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dd9394121d94a2f999a5588c2007ae7 in term 0.
I20260805 23:05:26.451610 14588 raft_consensus.cc:504] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.452387 14588 leader_election.cc:288] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [CANDIDATE]: Term 1 election: Requested vote from peers ef741ed37a4d4ea1974cc07469887298 (127.22.45.65:35905), d94fdc0d65fa409b82f7d2aa381434ca (127.22.45.67:36285)
I20260805 23:05:26.452968 14130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8eae6a96dd4655a2d8f9b2753c86f4" candidate_uuid: "8dd9394121d94a2f999a5588c2007ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef741ed37a4d4ea1974cc07469887298"
I20260805 23:05:26.453110 14487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b8eae6a96dd4655a2d8f9b2753c86f4" candidate_uuid: "8dd9394121d94a2f999a5588c2007ae7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d94fdc0d65fa409b82f7d2aa381434ca"
I20260805 23:05:26.453225 14130 raft_consensus.cc:3037] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:26.453348 14487 raft_consensus.cc:3037] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:26.456820 14130 raft_consensus.cc:2454] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd9394121d94a2f999a5588c2007ae7 in term 1.
I20260805 23:05:26.457084 14487 raft_consensus.cc:2454] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dd9394121d94a2f999a5588c2007ae7 in term 1.
I20260805 23:05:26.457424 14215 leader_election.cc:302] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dd9394121d94a2f999a5588c2007ae7, ef741ed37a4d4ea1974cc07469887298; no voters:
I20260805 23:05:26.457825 14588 raft_consensus.cc:2781] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:26.458392 14588 raft_consensus.cc:686] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 1 LEADER]: Becoming Leader. State: Replica: 8dd9394121d94a2f999a5588c2007ae7, State: Running, Role: LEADER
I20260805 23:05:26.459089 14588 consensus_queue.cc:237] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } }
I20260805 23:05:26.465472 13945 catalog_manager.cc:5495] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dd9394121d94a2f999a5588c2007ae7 (127.22.45.66). New cstate: current_term: 1 leader_uuid: "8dd9394121d94a2f999a5588c2007ae7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8dd9394121d94a2f999a5588c2007ae7" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 44533 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 } health_report { overall_health: UNKNOWN } } }
W20260805 23:05:26.480392 14563 tablet.cc:2369] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:26.484220 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.478452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36090 (local address 127.22.45.66:44533)
0805 23:05:26.478771 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.478777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.478800 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:05:26.478967 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.478973 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.479069 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.479220 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:05:26.479625 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.480382 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.481904 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.482345 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.482465 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.483046 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:05:26.483596 (+ 550us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:05:26.483764 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.483844 (+ 80us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.483940 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:05:26.493633 14130 raft_consensus.cc:1261] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 1 FOLLOWER]: Refusing update from remote peer 8dd9394121d94a2f999a5588c2007ae7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:26.493861 14487 raft_consensus.cc:1261] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 1 FOLLOWER]: Refusing update from remote peer 8dd9394121d94a2f999a5588c2007ae7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:26.494841 14593 consensus_queue.cc:1035] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef741ed37a4d4ea1974cc07469887298" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35905 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:26.495499 14588 consensus_queue.cc:1035] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d94fdc0d65fa409b82f7d2aa381434ca" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:26.533113 13946 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:26.533468 13946 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53952:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:26.537791 13946 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 750e6950cf7f463cb3964a876c6e6825: Sending DeleteTablet for 3 replicas of tablet 9b8eae6a96dd4655a2d8f9b2753c86f4
I20260805 23:05:26.539237 14459 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:26 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:53776
I20260805 23:05:26.539237 14106 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:26 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:46474
I20260805 23:05:26.539278 14282 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:26 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:36086
I20260805 23:05:26.542584 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 14030
I20260805 23:05:26.550491 14609 tablet_replica.cc:330] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: stopping tablet replica
I20260805 23:05:26.550529 14611 tablet_replica.cc:330] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: stopping tablet replica
I20260805 23:05:26.551380 14611 raft_consensus.cc:2229] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:05:26.551463 14609 raft_consensus.cc:2229] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:26.552284 14609 raft_consensus.cc:2258] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:26.552266 14611 raft_consensus.cc:2258] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:26.553220 14610 tablet_replica.cc:330] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: stopping tablet replica
I20260805 23:05:26.554064 14610 raft_consensus.cc:2229] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:26.554517 14611 ts_tablet_manager.cc:1905] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:26.554819 14610 raft_consensus.cc:2258] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:26.556578 14609 ts_tablet_manager.cc:1905] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:26.557173 14610 ts_tablet_manager.cc:1905] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:26.562062 14611 ts_tablet_manager.cc:1918] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:26.562278 14611 log.cc:1196] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/9b8eae6a96dd4655a2d8f9b2753c86f4
I20260805 23:05:26.562851 14611 ts_tablet_manager.cc:1939] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P 8dd9394121d94a2f999a5588c2007ae7: Deleting consensus metadata
I20260805 23:05:26.563900 14609 ts_tablet_manager.cc:1918] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:26.564090 14609 log.cc:1196] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/9b8eae6a96dd4655a2d8f9b2753c86f4
I20260805 23:05:26.564636 14609 ts_tablet_manager.cc:1939] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P d94fdc0d65fa409b82f7d2aa381434ca: Deleting consensus metadata
I20260805 23:05:26.564991 13924 catalog_manager.cc:4841] TS 8dd9394121d94a2f999a5588c2007ae7 (127.22.45.66:44533): tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 (table test-table [id=429682bf162f4ebd81dde80dc11e6b86]) successfully deleted
I20260805 23:05:26.566001 14610 ts_tablet_manager.cc:1918] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:26.566215 14610 log.cc:1196] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/9b8eae6a96dd4655a2d8f9b2753c86f4
I20260805 23:05:26.566367 13925 catalog_manager.cc:4841] TS d94fdc0d65fa409b82f7d2aa381434ca (127.22.45.67:36285): tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 (table test-table [id=429682bf162f4ebd81dde80dc11e6b86]) successfully deleted
I20260805 23:05:26.566763 14610 ts_tablet_manager.cc:1939] T 9b8eae6a96dd4655a2d8f9b2753c86f4 P ef741ed37a4d4ea1974cc07469887298: Deleting consensus metadata
I20260805 23:05:26.568681 13923 catalog_manager.cc:4841] TS ef741ed37a4d4ea1974cc07469887298 (127.22.45.65:35905): tablet 9b8eae6a96dd4655a2d8f9b2753c86f4 (table test-table [id=429682bf162f4ebd81dde80dc11e6b86]) successfully deleted
Aug 05 23:05:26 dist-test-slave-1vmg krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:05:26.582064 14579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.544655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46488 (local address 127.22.45.65:35905)
0805 23:05:26.544891 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.544898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.562003 (+ 17105us) server_negotiation.cc:407] Connection header received
0805 23:05:26.562561 (+ 558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.562567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.562659 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.562744 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:26.564635 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.565769 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.567831 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.568561 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.568709 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.573721 (+ 5012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:26.573744 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:26.573768 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:26.573825 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:26.577824 (+ 3999us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.579407 (+ 1583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.579418 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.579422 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.579634 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.580170 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.580175 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.580186 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.580735 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:26.581075 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.581373 (+ 298us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.581645 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260805 23:05:26.582890 14181 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:26.675683 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 14030
I20260805 23:05:26.707520 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 14193
Aug 05 23:05:26 dist-test-slave-1vmg krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:05:26.727145 14577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.708292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36102 (local address 127.22.45.66:44533)
0805 23:05:26.708501 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.708507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.708599 (+ 92us) server_negotiation.cc:407] Connection header received
0805 23:05:26.708785 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.708790 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.708858 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.708957 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:26.710413 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.711507 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.712914 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.713383 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.713500 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.719212 (+ 5712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:26.719240 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:26.719262 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:26.719465 (+ 203us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:26.723606 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.724611 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.724621 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.724623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.724823 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.725239 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.725243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.725245 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.725655 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:26.726019 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.726334 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.726607 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 23:05:26.728035 14359 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:26.847281 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 14193
I20260805 23:05:26.869887 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 14376
Aug 05 23:05:26 dist-test-slave-1vmg krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971123, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:05:26.886531 14581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:26.870605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53782 (local address 127.22.45.67:36285)
0805 23:05:26.870793 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:26.870799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:26.870820 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:05:26.871044 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:26.871048 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:26.871130 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:26.871218 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:26.872548 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.873303 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.874988 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:26.875461 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:26.875600 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:26.880584 (+ 4984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:26.880607 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:26.880627 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:26.880677 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:26.883733 (+ 3056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.884558 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.884565 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.884567 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.884738 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:26.885074 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:26.885077 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:26.885079 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:26.885467 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:26.885713 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:26.885989 (+ 276us) server_negotiation.cc:299] Negotiation successful
0805 23:05:26.886205 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260805 23:05:26.887485 14551 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:26.981500 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 14376
I20260805 23:05:27.001466 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 13894
I20260805 23:05:27.002740 13991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:27.117285 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 13894
2026-08-05T23:05:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4663 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-05T23:05:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:27Z Disabled control of system clock
I20260805 23:05:27.214707 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46825
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:36261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:46825
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 23:05:27.590893 14626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:27.591360 14626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:27.591511 14626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:27.599349 14626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:27.599511 14626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:27.599565 14626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:27.599659 14626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:27.599741 14626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:27.610080 14626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:46825
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:46825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:27.611559 14626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:27.613561 14626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:27.626871 14634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:27.626952 14636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:27.627002 14633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:27.627916 14626 server_base.cc:1034] running on GCE node
I20260805 23:05:27.628834 14626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:27.630450 14626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:27.631685 14626 hybrid_clock.cc:648] HybridClock initialized: now 1785971127631634 us; error 50 us; skew 500 ppm
I20260805 23:05:27.632073 14626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:27.634711 14626 webserver.cc:460] Webserver started at http://127.22.45.126:37337/ using document root <none> and password file <none>
I20260805 23:05:27.635510 14626 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:27.635620 14626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:27.635926 14626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:27.639215 14626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "d7d135f2e7f54d348b4f5b53310e02e6"
format_stamp: "Formatted at 2026-08-05 23:05:27 on dist-test-slave-1vmg"
server_key: "b97b863758271b3d21fe7b8ba5aab7fa"
server_key_iv: "2ac5638083d359d009b2076eb571b24e"
server_key_version: "encryptionkey@0"
I20260805 23:05:27.640125 14626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "d7d135f2e7f54d348b4f5b53310e02e6"
format_stamp: "Formatted at 2026-08-05 23:05:27 on dist-test-slave-1vmg"
server_key: "b97b863758271b3d21fe7b8ba5aab7fa"
server_key_iv: "2ac5638083d359d009b2076eb571b24e"
server_key_version: "encryptionkey@0"
I20260805 23:05:27.646260 14626 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:05:27.650573 14644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:27.652169 14626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:27.652374 14626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "d7d135f2e7f54d348b4f5b53310e02e6"
format_stamp: "Formatted at 2026-08-05 23:05:27 on dist-test-slave-1vmg"
server_key: "b97b863758271b3d21fe7b8ba5aab7fa"
server_key_iv: "2ac5638083d359d009b2076eb571b24e"
server_key_version: "encryptionkey@0"
I20260805 23:05:27.652623 14626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:27.675091 14626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:27.676164 14626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:27.676509 14626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:27.697294 14626 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:46825
I20260805 23:05:27.697314 14712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:46825 every 8 connection(s)
I20260805 23:05:27.698988 14626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:27.703774 14715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:27.707387 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 14626
I20260805 23:05:27.707587 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:27.708065 22709 external_mini_cluster.cc:1428] Setting key 9351ac1d720d31170bd451a18f809dd0
I20260805 23:05:27.717578 14715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6: Bootstrap starting.
I20260805 23:05:27.721192 14715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:27.722532 14715 log.cc:824] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:27.723539 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:27.710381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58172 (local address 127.22.45.126:46825)
0805 23:05:27.711695 (+ 1314us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:27.711718 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:27.711777 (+ 59us) server_negotiation.cc:407] Connection header received
0805 23:05:27.713693 (+ 1916us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:27.713730 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:27.714366 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:27.714837 (+ 471us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:27.715527 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:27.716853 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:27.718416 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:27.719262 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:27.719465 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:27.720657 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:27.720666 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:27.720683 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:27.721309 (+ 626us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:27.721457 (+ 148us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:27.721508 (+ 51us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:27.721644 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:27.721912 (+ 268us) server_negotiation.cc:299] Negotiation successful
0805 23:05:27.722260 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":789,"thread_start_us":510,"threads_started":1}
I20260805 23:05:27.725996 14715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6: No bootstrap required, opened a new log
I20260805 23:05:27.734138 14715 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46825 } }
I20260805 23:05:27.734634 14715 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:27.734747 14715 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7d135f2e7f54d348b4f5b53310e02e6, State: Initialized, Role: FOLLOWER
I20260805 23:05:27.735433 14715 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46825 } }
I20260805 23:05:27.735703 14715 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:27.735859 14715 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:27.736028 14715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:27.738773 14715 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46825 } }
I20260805 23:05:27.739425 14715 leader_election.cc:302] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7d135f2e7f54d348b4f5b53310e02e6; no voters:
I20260805 23:05:27.740092 14715 leader_election.cc:288] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:27.740284 14723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:27.741165 14723 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [term 1 LEADER]: Becoming Leader. State: Replica: d7d135f2e7f54d348b4f5b53310e02e6, State: Running, Role: LEADER
I20260805 23:05:27.741780 14723 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46825 } }
I20260805 23:05:27.742436 14715 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:27.745249 14728 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46825 } } }
I20260805 23:05:27.745810 14728 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:27.745725 14730 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7d135f2e7f54d348b4f5b53310e02e6. Latest consensus state: current_term: 1 leader_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7d135f2e7f54d348b4f5b53310e02e6" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 46825 } } }
I20260805 23:05:27.746037 14730 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:27.746874 14736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:27.753871 14736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:27.765753 14736 catalog_manager.cc:1347] Generated new cluster ID: 89ab7fd6a796406b946fb54ffe128515
I20260805 23:05:27.765908 14736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:27.794068 14736 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:27.796216 14736 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:27.813630 14736 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6: Generated new TSK 0
I20260805 23:05:27.814901 14736 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:27.826329 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46825
--builtin_ntp_servers=127.22.45.84:36261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 23:05:28.199415 14753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:28.199834 14753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:28.199990 14753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:28.210806 14753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:28.210973 14753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:28.211159 14753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:05:28.221684 14753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:28.223147 14753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:28.225121 14753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:28.239012 14760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:28.239252 14758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:28.239068 14762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:28.239962 14753 server_base.cc:1034] running on GCE node
I20260805 23:05:28.240729 14753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:28.241806 14753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:28.243017 14753 hybrid_clock.cc:648] HybridClock initialized: now 1785971128242963 us; error 49 us; skew 500 ppm
I20260805 23:05:28.243412 14753 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:28.246172 14753 webserver.cc:460] Webserver started at http://127.22.45.65:38207/ using document root <none> and password file <none>
I20260805 23:05:28.247047 14753 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:28.247171 14753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:28.247529 14753 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:28.250690 14753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "c6f397a4bd944f7e8262ba47daa9c2d8"
format_stamp: "Formatted at 2026-08-05 23:05:28 on dist-test-slave-1vmg"
server_key: "eadf85ec9223cd236c006badd76ae0fb"
server_key_iv: "8feaeacb632e7175a168e568e3ceaed6"
server_key_version: "encryptionkey@0"
I20260805 23:05:28.251642 14753 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "c6f397a4bd944f7e8262ba47daa9c2d8"
format_stamp: "Formatted at 2026-08-05 23:05:28 on dist-test-slave-1vmg"
server_key: "eadf85ec9223cd236c006badd76ae0fb"
server_key_iv: "8feaeacb632e7175a168e568e3ceaed6"
server_key_version: "encryptionkey@0"
I20260805 23:05:28.258067 14753 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260805 23:05:28.262295 14771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:28.263945 14753 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260805 23:05:28.264150 14753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "c6f397a4bd944f7e8262ba47daa9c2d8"
format_stamp: "Formatted at 2026-08-05 23:05:28 on dist-test-slave-1vmg"
server_key: "eadf85ec9223cd236c006badd76ae0fb"
server_key_iv: "8feaeacb632e7175a168e568e3ceaed6"
server_key_version: "encryptionkey@0"
I20260805 23:05:28.264410 14753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:28.281975 14753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:28.283005 14753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:28.283352 14753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:28.284440 14753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:28.286106 14753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:28.286231 14753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:28.286353 14753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:28.286428 14753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:28.319604 14753 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:35601
I20260805 23:05:28.319653 14929 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:35601 every 8 connection(s)
I20260805 23:05:28.321111 14753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:05:28.322367 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 14753
I20260805 23:05:28.322562 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:05:28.323220 22709 external_mini_cluster.cc:1428] Setting key c0f5afc6b809e709462a4187fd40cad1
I20260805 23:05:28.326728 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46825
--builtin_ntp_servers=127.22.45.84:36261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 23:05:28.336783 14933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:28.324292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:45191 (local address 127.22.45.126:46825)
0805 23:05:28.324805 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:28.324811 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:28.326390 (+ 1579us) server_negotiation.cc:407] Connection header received
0805 23:05:28.328970 (+ 2580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:28.328974 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:28.329058 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:28.329159 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:28.330677 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.331542 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.333718 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.334172 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.334289 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:28.335986 (+ 1697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:28.335991 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:28.335994 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:28.336016 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:28.336060 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:28.336073 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:28.336148 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:28.336407 (+ 259us) server_negotiation.cc:299] Negotiation successful
0805 23:05:28.336499 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":263,"threads_started":1}
I20260805 23:05:28.338160 14934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:28.324982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46825 (local address 127.22.45.65:45191)
0805 23:05:28.326182 (+ 1200us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:28.326251 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:28.328601 (+ 2350us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:28.329451 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:28.329464 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:28.329595 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:28.330436 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:28.330460 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.331736 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.331741 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:28.333549 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:28.333567 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.334425 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.334432 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:28.334734 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:28.335591 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:28.335595 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:28.335653 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:28.335764 (+ 111us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:28.336165 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:28.336176 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:28.336183 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 23:05:28.336375 (+ 192us) client_negotiation.cc:240] Negotiation successful
0805 23:05:28.336808 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":366,"threads_started":1}
I20260805 23:05:28.339890 14931 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46825
I20260805 23:05:28.340202 14931 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:28.341007 14931 heartbeater.cc:511] Master 127.22.45.126:46825 requested a full tablet report, sending...
I20260805 23:05:28.343276 14663 ts_manager.cc:194] Registered new tserver with Master: c6f397a4bd944f7e8262ba47daa9c2d8 (127.22.45.65:35601)
I20260805 23:05:28.344908 14663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.65:45191
W20260805 23:05:28.678496 14936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:28.678849 14936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:28.679005 14936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:28.686755 14936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:28.686889 14936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:28.687059 14936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:05:28.696769 14936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:28.698269 14936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:28.700299 14936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:28.716168 14943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:28.716095 14946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:28.716135 14944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:28.717258 14936 server_base.cc:1034] running on GCE node
I20260805 23:05:28.717968 14936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:28.719067 14936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:28.720288 14936 hybrid_clock.cc:648] HybridClock initialized: now 1785971128720242 us; error 53 us; skew 500 ppm
I20260805 23:05:28.720618 14936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:28.723076 14936 webserver.cc:460] Webserver started at http://127.22.45.66:46187/ using document root <none> and password file <none>
I20260805 23:05:28.723804 14936 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:28.723918 14936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:28.724227 14936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:28.727319 14936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "26b36dfb43f744f2a4f9cee9a760201a"
format_stamp: "Formatted at 2026-08-05 23:05:28 on dist-test-slave-1vmg"
server_key: "197f27f790eec236c15205e99444ef2d"
server_key_iv: "615f2335480f06a6736591e70d557ffa"
server_key_version: "encryptionkey@0"
I20260805 23:05:28.728193 14936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "26b36dfb43f744f2a4f9cee9a760201a"
format_stamp: "Formatted at 2026-08-05 23:05:28 on dist-test-slave-1vmg"
server_key: "197f27f790eec236c15205e99444ef2d"
server_key_iv: "615f2335480f06a6736591e70d557ffa"
server_key_version: "encryptionkey@0"
I20260805 23:05:28.734117 14936 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 23:05:28.738289 14953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:28.739931 14936 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:28.740132 14936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "26b36dfb43f744f2a4f9cee9a760201a"
format_stamp: "Formatted at 2026-08-05 23:05:28 on dist-test-slave-1vmg"
server_key: "197f27f790eec236c15205e99444ef2d"
server_key_iv: "615f2335480f06a6736591e70d557ffa"
server_key_version: "encryptionkey@0"
I20260805 23:05:28.740372 14936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:28.763835 14936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:28.764839 14936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:28.765177 14936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:28.766335 14936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:28.768323 14936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:28.768457 14936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:28.768761 14936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:28.768896 14936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:28.803887 14936 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:41817
I20260805 23:05:28.803956 15099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:41817 every 8 connection(s)
I20260805 23:05:28.805274 14936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:05:28.810444 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 14936
I20260805 23:05:28.810673 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:05:28.811285 22709 external_mini_cluster.cc:1428] Setting key 33550dddbac4e81ceb782fc3be6ec507
I20260805 23:05:28.814742 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46825
--builtin_ntp_servers=127.22.45.84:36261
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 23:05:28.821036 14933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:28.808399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:40161 (local address 127.22.45.126:46825)
0805 23:05:28.808641 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:28.808649 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:28.810035 (+ 1386us) server_negotiation.cc:407] Connection header received
0805 23:05:28.812540 (+ 2505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:28.812547 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:28.812637 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:28.812763 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:28.814282 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.815258 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.817602 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.818142 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.818268 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:28.820091 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:28.820097 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:28.820100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:28.820124 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:28.820230 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:28.820252 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:28.820343 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:28.820654 (+ 311us) server_negotiation.cc:299] Negotiation successful
0805 23:05:28.820765 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 23:05:28.822520 15102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:28.808792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46825 (local address 127.22.45.66:40161)
0805 23:05:28.809827 (+ 1035us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:28.809867 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:28.812186 (+ 2319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:28.813038 (+ 852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:28.813047 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:28.813150 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:28.814075 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:28.814104 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.815435 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.815440 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:28.817401 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:28.817419 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:28.818435 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:28.818443 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:28.818758 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:28.819621 (+ 863us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:28.819624 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:28.819684 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:28.819827 (+ 143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:28.820362 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:28.820374 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:28.820382 (+ 8us) client_negotiation.cc:769] Sending connection context
0805 23:05:28.820591 (+ 209us) client_negotiation.cc:240] Negotiation successful
0805 23:05:28.821060 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":335,"threads_started":1}
I20260805 23:05:28.824244 15100 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46825
I20260805 23:05:28.824606 15100 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:28.825757 15100 heartbeater.cc:511] Master 127.22.45.126:46825 requested a full tablet report, sending...
I20260805 23:05:28.827658 14663 ts_manager.cc:194] Registered new tserver with Master: 26b36dfb43f744f2a4f9cee9a760201a (127.22.45.66:41817)
I20260805 23:05:28.828662 14663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.66:40161
W20260805 23:05:29.186331 15104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:29.186690 15104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:29.186782 15104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:29.194525 15104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:29.194676 15104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:29.194794 15104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:05:29.204691 15104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36261
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:46825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:29.206126 15104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:29.208221 15104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:29.223578 15112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:29.223506 15110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:29.223547 15109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:29.225164 15104 server_base.cc:1034] running on GCE node
I20260805 23:05:29.225930 15104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:29.227108 15104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:29.228355 15104 hybrid_clock.cc:648] HybridClock initialized: now 1785971129228273 us; error 69 us; skew 500 ppm
I20260805 23:05:29.228678 15104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:29.231166 15104 webserver.cc:460] Webserver started at http://127.22.45.67:43781/ using document root <none> and password file <none>
I20260805 23:05:29.231932 15104 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:29.232039 15104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:29.232348 15104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:29.235621 15104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "f80a0b09f78441b7b0999b8b80c33623"
format_stamp: "Formatted at 2026-08-05 23:05:29 on dist-test-slave-1vmg"
server_key: "0ca27f3ea24ad6e21f25d68bb7000ce4"
server_key_iv: "d928e896c6386a9dfc13d2ac5c0f1314"
server_key_version: "encryptionkey@0"
I20260805 23:05:29.236510 15104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "f80a0b09f78441b7b0999b8b80c33623"
format_stamp: "Formatted at 2026-08-05 23:05:29 on dist-test-slave-1vmg"
server_key: "0ca27f3ea24ad6e21f25d68bb7000ce4"
server_key_iv: "d928e896c6386a9dfc13d2ac5c0f1314"
server_key_version: "encryptionkey@0"
I20260805 23:05:29.242655 15104 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 23:05:29.246906 15120 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:29.248589 15104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:29.248761 15104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "f80a0b09f78441b7b0999b8b80c33623"
format_stamp: "Formatted at 2026-08-05 23:05:29 on dist-test-slave-1vmg"
server_key: "0ca27f3ea24ad6e21f25d68bb7000ce4"
server_key_iv: "d928e896c6386a9dfc13d2ac5c0f1314"
server_key_version: "encryptionkey@0"
I20260805 23:05:29.248972 15104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:29.271580 15104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:29.272509 15104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:29.272794 15104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:29.273859 15104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:29.275588 15104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:29.275694 15104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:29.275789 15104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:29.275847 15104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:29.307440 15104 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:43047
I20260805 23:05:29.307508 15263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:43047 every 8 connection(s)
I20260805 23:05:29.308779 15104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:05:29.310999 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 15104
I20260805 23:05:29.311188 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:05:29.311690 22709 external_mini_cluster.cc:1428] Setting key 268855148860fcc8350ffca19d2a26ce
I20260805 23:05:29.322540 14933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.311644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:51535 (local address 127.22.45.126:46825)
0805 23:05:29.311881 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.311888 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.313571 (+ 1683us) server_negotiation.cc:407] Connection header received
0805 23:05:29.315624 (+ 2053us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.315629 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.315703 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.315788 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:29.316972 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.317780 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.319521 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.320167 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.320315 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.321677 (+ 1362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:29.321683 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:29.321688 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:29.321714 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:29.321756 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:29.321774 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:29.321873 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.322057 (+ 184us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.322164 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260805 23:05:29.323531 15267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.312263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:46825 (local address 127.22.45.67:51535)
0805 23:05:29.313400 (+ 1137us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:29.313446 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:29.315350 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:29.316004 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:29.316013 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:29.316115 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:29.316762 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.316781 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.317917 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.317920 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.319346 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.319363 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.320376 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.320380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.320591 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.321326 (+ 735us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:29.321329 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:29.321377 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:29.321463 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:29.321865 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:29.321871 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:29.321876 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 23:05:29.322022 (+ 146us) client_negotiation.cc:240] Negotiation successful
0805 23:05:29.322345 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":373,"threads_started":1}
I20260805 23:05:29.325062 15264 heartbeater.cc:347] Connected to a master server at 127.22.45.126:46825
I20260805 23:05:29.325413 15264 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:29.326375 15264 heartbeater.cc:511] Master 127.22.45.126:46825 requested a full tablet report, sending...
I20260805 23:05:29.327914 14663 ts_manager.cc:194] Registered new tserver with Master: f80a0b09f78441b7b0999b8b80c33623 (127.22.45.67:43047)
I20260805 23:05:29.328958 14663 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.67:51535
I20260805 23:05:29.340237 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:05:29.348448 14931 heartbeater.cc:503] Master 127.22.45.126:46825 was elected leader, sending a full tablet report...
I20260805 23:05:29.351233 14933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.344934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58178 (local address 127.22.45.126:46825)
0805 23:05:29.345168 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.345176 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.345555 (+ 379us) server_negotiation.cc:407] Connection header received
0805 23:05:29.345710 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.345714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.345799 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.345917 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:29.346423 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.347212 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.348652 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.349287 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.349396 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.350580 (+ 1184us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:29.350584 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:29.350588 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:29.350606 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:29.350639 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:29.350650 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:29.350727 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.350799 (+ 72us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.350876 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 23:05:29.355078 14663 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:05:29.362268 14663 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:05:29.398640 15280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.375190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:35601 (local address 127.0.0.1:34912)
0805 23:05:29.387878 (+ 12688us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:29.387937 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:29.388180 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:29.389086 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:29.389093 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:29.389129 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:29.389606 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.389621 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.391920 (+ 2299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.391927 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.394678 (+ 2751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.394700 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.397488 (+ 2788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.397495 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.397752 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.397812 (+ 60us) client_negotiation.cc:769] Sending connection context
0805 23:05:29.397967 (+ 155us) client_negotiation.cc:240] Negotiation successful
0805 23:05:29.398238 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12352,"thread_start_us":12501,"threads_started":1}
I20260805 23:05:29.399432 15284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.376095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38504 (local address 127.22.45.67:43047)
0805 23:05:29.388318 (+ 12223us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.388327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.389341 (+ 1014us) server_negotiation.cc:407] Connection header received
0805 23:05:29.389455 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.389462 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.389692 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.389921 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:29.391017 (+ 1096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.392734 (+ 1717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.395755 (+ 3021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.397349 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.397471 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.397778 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.398781 (+ 1003us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.399034 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12019,"thread_start_us":12242,"threads_started":1}
I20260805 23:05:29.399890 15282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.375371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34912 (local address 127.22.45.65:35601)
0805 23:05:29.387641 (+ 12270us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.387653 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.388487 (+ 834us) server_negotiation.cc:407] Connection header received
0805 23:05:29.388602 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.388611 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.388845 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.389034 (+ 189us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:29.389879 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.391718 (+ 1839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.395012 (+ 3294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.396797 (+ 1785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.396952 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.397324 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.399322 (+ 1998us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.399514 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12003,"thread_start_us":13015,"threads_started":1}
I20260805 23:05:29.400305 15283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.375499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:43047 (local address 127.0.0.1:38504)
0805 23:05:29.389020 (+ 13521us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:29.389039 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:29.389188 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:29.390244 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:29.390250 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:29.390284 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:29.390727 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.390738 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.392954 (+ 2216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.392961 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.395465 (+ 2504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.395483 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.397992 (+ 2509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.398000 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.398238 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.398275 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 23:05:29.398362 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 23:05:29.398516 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13368,"spinlock_wait_cycles":7040,"thread_start_us":13233,"threads_started":1}
I20260805 23:05:29.404170 15178 tablet_service.cc:1467] Processing CreateTablet for tablet d431a4b04b7241eda923d31d81bddb3a (DEFAULT_TABLE table=test-table [id=9a3398443be34740bf3e7150f3b1b3b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:29.404171 14830 tablet_service.cc:1467] Processing CreateTablet for tablet d431a4b04b7241eda923d31d81bddb3a (DEFAULT_TABLE table=test-table [id=9a3398443be34740bf3e7150f3b1b3b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:29.405817 14830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d431a4b04b7241eda923d31d81bddb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:29.405840 15178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d431a4b04b7241eda923d31d81bddb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:29.407469 15280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.389465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:41817 (local address 127.0.0.1:41102)
0805 23:05:29.399004 (+ 9539us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:29.399026 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:29.399139 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:29.402101 (+ 2962us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:29.402106 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:29.402133 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:29.402309 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.402320 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.403954 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.403959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.405259 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.405272 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.406654 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.406660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.406880 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.406949 (+ 69us) client_negotiation.cc:769] Sending connection context
0805 23:05:29.407019 (+ 70us) client_negotiation.cc:240] Negotiation successful
0805 23:05:29.407174 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9390,"thread_start_us":10392,"threads_started":1}
I20260805 23:05:29.408502 15285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.389488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41102 (local address 127.22.45.66:41817)
0805 23:05:29.401603 (+ 12115us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.401611 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.401637 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:05:29.401724 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.401730 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.401917 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.402089 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:29.402448 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.403790 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.405405 (+ 1615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.406417 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.407725 (+ 1308us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.408008 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.408087 (+ 79us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.408257 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11965,"thread_start_us":11866,"threads_started":1}
I20260805 23:05:29.412087 15014 tablet_service.cc:1467] Processing CreateTablet for tablet d431a4b04b7241eda923d31d81bddb3a (DEFAULT_TABLE table=test-table [id=9a3398443be34740bf3e7150f3b1b3b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:29.413545 15014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d431a4b04b7241eda923d31d81bddb3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:29.421391 15287 tablet_bootstrap.cc:492] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Bootstrap starting.
I20260805 23:05:29.422287 15288 tablet_bootstrap.cc:492] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Bootstrap starting.
I20260805 23:05:29.426079 15287 tablet_bootstrap.cc:654] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:29.426699 15288 tablet_bootstrap.cc:654] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:29.427350 15287 log.cc:824] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:29.427660 15289 tablet_bootstrap.cc:492] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Bootstrap starting.
I20260805 23:05:29.428020 15288 log.cc:824] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:29.431443 15287 tablet_bootstrap.cc:492] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: No bootstrap required, opened a new log
I20260805 23:05:29.431464 15288 tablet_bootstrap.cc:492] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: No bootstrap required, opened a new log
I20260805 23:05:29.431690 15289 tablet_bootstrap.cc:654] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:29.431761 15288 ts_tablet_manager.cc:1397] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260805 23:05:29.431763 15287 ts_tablet_manager.cc:1397] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260805 23:05:29.432848 15289 log.cc:824] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:29.435827 15289 tablet_bootstrap.cc:492] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: No bootstrap required, opened a new log
I20260805 23:05:29.436108 15289 ts_tablet_manager.cc:1397] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260805 23:05:29.442901 15287 raft_consensus.cc:348] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.442901 15288 raft_consensus.cc:348] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.443501 15287 raft_consensus.cc:374] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:29.443501 15288 raft_consensus.cc:374] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:29.443616 15288 raft_consensus.cc:729] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f397a4bd944f7e8262ba47daa9c2d8, State: Initialized, Role: FOLLOWER
I20260805 23:05:29.443624 15287 raft_consensus.cc:729] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f80a0b09f78441b7b0999b8b80c33623, State: Initialized, Role: FOLLOWER
I20260805 23:05:29.444408 15288 consensus_queue.cc:260] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.444408 15287 consensus_queue.cc:260] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.444617 15289 raft_consensus.cc:348] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.445143 15289 raft_consensus.cc:374] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:29.445281 15289 raft_consensus.cc:729] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b36dfb43f744f2a4f9cee9a760201a, State: Initialized, Role: FOLLOWER
I20260805 23:05:29.446113 15264 heartbeater.cc:503] Master 127.22.45.126:46825 was elected leader, sending a full tablet report...
I20260805 23:05:29.446007 15289 consensus_queue.cc:260] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.446596 15288 ts_tablet_manager.cc:1428] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Time spent starting tablet: real 0.015s user 0.009s sys 0.004s
I20260805 23:05:29.447291 15100 heartbeater.cc:503] Master 127.22.45.126:46825 was elected leader, sending a full tablet report...
I20260805 23:05:29.447881 15289 ts_tablet_manager.cc:1428] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20260805 23:05:29.449131 15287 ts_tablet_manager.cc:1428] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Time spent starting tablet: real 0.017s user 0.015s sys 0.000s
W20260805 23:05:29.557453 15101 tablet.cc:2369] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:05:29.560509 15265 tablet.cc:2369] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260805 23:05:29.573869 14932 tablet.cc:2369] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:29.631444 15297 raft_consensus.cc:482] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:05:29.631803 15297 raft_consensus.cc:504] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.633693 15297 leader_election.cc:288] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6f397a4bd944f7e8262ba47daa9c2d8 (127.22.45.65:35601), f80a0b09f78441b7b0999b8b80c33623 (127.22.45.67:43047)
I20260805 23:05:29.641767 15284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.634114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:59005 (local address 127.22.45.67:43047)
0805 23:05:29.634363 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.634370 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.635356 (+ 986us) server_negotiation.cc:407] Connection header received
0805 23:05:29.635505 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.635509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.635574 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.635664 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:29.636404 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.637542 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.640029 (+ 2487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.640855 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.641014 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.641094 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.641383 (+ 289us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.641510 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:05:29.641844 15282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.634247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:42729 (local address 127.22.45.65:35601)
0805 23:05:29.634454 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.634457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.635222 (+ 765us) server_negotiation.cc:407] Connection header received
0805 23:05:29.635444 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.635451 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.635546 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.635634 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:29.636480 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.637542 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.640023 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.640871 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.641035 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.641112 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.641473 (+ 361us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.641611 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 23:05:29.641881 15299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.634430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:43047 (local address 127.22.45.66:59005)
0805 23:05:29.635231 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:29.635249 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:29.635381 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:29.635706 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:29.635711 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:29.635736 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:29.636198 (+ 462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.636210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.637746 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.637750 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.639819 (+ 2069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.639833 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.641075 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.641081 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.641235 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.641259 (+ 24us) client_negotiation.cc:769] Sending connection context
0805 23:05:29.641342 (+ 83us) client_negotiation.cc:240] Negotiation successful
0805 23:05:29.641484 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":111,"thread_start_us":484,"threads_started":1}
I20260805 23:05:29.641978 15298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.634112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:35601 (local address 127.22.45.66:42729)
0805 23:05:29.635071 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:29.635097 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:29.635282 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:29.635681 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:29.635685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:29.635711 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:29.636322 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.636337 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.637679 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.637683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.639782 (+ 2099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:29.639803 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.641109 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.641117 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:29.641299 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.641331 (+ 32us) client_negotiation.cc:769] Sending connection context
0805 23:05:29.641407 (+ 76us) client_negotiation.cc:240] Negotiation successful
0805 23:05:29.641556 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":787,"mutex_wait_us":113,"thread_start_us":501,"threads_started":1}
I20260805 23:05:29.643105 14864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d431a4b04b7241eda923d31d81bddb3a" candidate_uuid: "26b36dfb43f744f2a4f9cee9a760201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" is_pre_election: true
I20260805 23:05:29.643126 15202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d431a4b04b7241eda923d31d81bddb3a" candidate_uuid: "26b36dfb43f744f2a4f9cee9a760201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f80a0b09f78441b7b0999b8b80c33623" is_pre_election: true
I20260805 23:05:29.643656 15202 raft_consensus.cc:2454] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b36dfb43f744f2a4f9cee9a760201a in term 0.
I20260805 23:05:29.643661 14864 raft_consensus.cc:2454] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b36dfb43f744f2a4f9cee9a760201a in term 0.
I20260805 23:05:29.644299 14957 leader_election.cc:302] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b36dfb43f744f2a4f9cee9a760201a, f80a0b09f78441b7b0999b8b80c33623; no voters:
I20260805 23:05:29.644758 15297 raft_consensus.cc:2781] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:05:29.644898 15297 raft_consensus.cc:482] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:05:29.644999 15297 raft_consensus.cc:3037] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:29.647466 15297 raft_consensus.cc:504] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.648180 15297 leader_election.cc:288] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [CANDIDATE]: Term 1 election: Requested vote from peers c6f397a4bd944f7e8262ba47daa9c2d8 (127.22.45.65:35601), f80a0b09f78441b7b0999b8b80c33623 (127.22.45.67:43047)
I20260805 23:05:29.648685 14864 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d431a4b04b7241eda923d31d81bddb3a" candidate_uuid: "26b36dfb43f744f2a4f9cee9a760201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8"
I20260805 23:05:29.648690 15202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d431a4b04b7241eda923d31d81bddb3a" candidate_uuid: "26b36dfb43f744f2a4f9cee9a760201a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f80a0b09f78441b7b0999b8b80c33623"
I20260805 23:05:29.648883 15202 raft_consensus.cc:3037] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:29.648880 14864 raft_consensus.cc:3037] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:29.651157 14864 raft_consensus.cc:2454] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b36dfb43f744f2a4f9cee9a760201a in term 1.
I20260805 23:05:29.651170 15202 raft_consensus.cc:2454] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b36dfb43f744f2a4f9cee9a760201a in term 1.
I20260805 23:05:29.651615 14956 leader_election.cc:302] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 26b36dfb43f744f2a4f9cee9a760201a, c6f397a4bd944f7e8262ba47daa9c2d8, f80a0b09f78441b7b0999b8b80c33623; no voters:
I20260805 23:05:29.651924 15297 raft_consensus.cc:2781] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:29.652383 15297 raft_consensus.cc:686] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 1 LEADER]: Becoming Leader. State: Replica: 26b36dfb43f744f2a4f9cee9a760201a, State: Running, Role: LEADER
I20260805 23:05:29.652897 15297 consensus_queue.cc:237] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } }
I20260805 23:05:29.658092 14660 catalog_manager.cc:5495] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b36dfb43f744f2a4f9cee9a760201a (127.22.45.66). New cstate: current_term: 1 leader_uuid: "26b36dfb43f744f2a4f9cee9a760201a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b36dfb43f744f2a4f9cee9a760201a" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 41817 } health_report { overall_health: HEALTHY } } }
I20260805 23:05:29.710053 15285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.704457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41112 (local address 127.22.45.66:41817)
0805 23:05:29.704677 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.704683 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.704704 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:05:29.704947 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.704951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.705058 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.705214 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:05:29.705581 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.706287 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.707772 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.708199 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.708326 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.708857 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:05:29.709441 (+ 584us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:05:29.709583 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.709689 (+ 106us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.709780 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 23:05:29.719080 15202 raft_consensus.cc:1261] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 1 FOLLOWER]: Refusing update from remote peer 26b36dfb43f744f2a4f9cee9a760201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:29.719081 14864 raft_consensus.cc:1261] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 1 FOLLOWER]: Refusing update from remote peer 26b36dfb43f744f2a4f9cee9a760201a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:29.720247 15300 consensus_queue.cc:1035] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6f397a4bd944f7e8262ba47daa9c2d8" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 35601 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:29.720630 15297 consensus_queue.cc:1035] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f80a0b09f78441b7b0999b8b80c33623" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 43047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:29.749603 14660 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:29.749941 14660 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58178:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:29.753927 14660 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d7d135f2e7f54d348b4f5b53310e02e6: Sending DeleteTablet for 3 replicas of tablet d431a4b04b7241eda923d31d81bddb3a
I20260805 23:05:29.755456 14830 tablet_service.cc:1514] Processing DeleteTablet for tablet d431a4b04b7241eda923d31d81bddb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:29 UTC) from {username='slave'} at 127.0.0.1:34912
I20260805 23:05:29.755481 15178 tablet_service.cc:1514] Processing DeleteTablet for tablet d431a4b04b7241eda923d31d81bddb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:29 UTC) from {username='slave'} at 127.0.0.1:38504
I20260805 23:05:29.755729 15014 tablet_service.cc:1514] Processing DeleteTablet for tablet d431a4b04b7241eda923d31d81bddb3a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:29 UTC) from {username='slave'} at 127.0.0.1:41102
I20260805 23:05:29.758075 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 14753
I20260805 23:05:29.766162 15320 tablet_replica.cc:330] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: stopping tablet replica
I20260805 23:05:29.767688 15320 raft_consensus.cc:2229] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:05:29.770195 15320 raft_consensus.cc:2258] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:29.774967 15319 tablet_replica.cc:330] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: stopping tablet replica
I20260805 23:05:29.775319 15318 tablet_replica.cc:330] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: stopping tablet replica
I20260805 23:05:29.775792 15318 raft_consensus.cc:2229] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:29.775813 15319 raft_consensus.cc:2229] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:29.776381 15318 raft_consensus.cc:2258] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:29.776553 15319 raft_consensus.cc:2258] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:29.778007 15320 ts_tablet_manager.cc:1905] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:29.779284 15319 ts_tablet_manager.cc:1905] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:29.786116 15319 ts_tablet_manager.cc:1918] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:29.786458 15319 log.cc:1196] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/d431a4b04b7241eda923d31d81bddb3a
I20260805 23:05:29.786439 15320 ts_tablet_manager.cc:1918] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:29.786626 15320 log.cc:1196] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/d431a4b04b7241eda923d31d81bddb3a
I20260805 23:05:29.787282 15319 ts_tablet_manager.cc:1939] T d431a4b04b7241eda923d31d81bddb3a P c6f397a4bd944f7e8262ba47daa9c2d8: Deleting consensus metadata
I20260805 23:05:29.787276 15320 ts_tablet_manager.cc:1939] T d431a4b04b7241eda923d31d81bddb3a P 26b36dfb43f744f2a4f9cee9a760201a: Deleting consensus metadata
I20260805 23:05:29.787676 15282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.759685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34928 (local address 127.22.45.65:35601)
0805 23:05:29.759901 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.759908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.773299 (+ 13391us) server_negotiation.cc:407] Connection header received
0805 23:05:29.774832 (+ 1533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.774839 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.774984 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.775109 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:29.775863 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.777071 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.779083 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.779710 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.779859 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.785700 (+ 5841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:29.785716 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:29.785734 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:29.786559 (+ 825us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:29.786638 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:29.786669 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:29.786776 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.787154 (+ 378us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.787296 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 23:05:29.788997 14924 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:29.789443 14647 catalog_manager.cc:4841] TS 26b36dfb43f744f2a4f9cee9a760201a (127.22.45.66:41817): tablet d431a4b04b7241eda923d31d81bddb3a (table test-table [id=9a3398443be34740bf3e7150f3b1b3b3]) successfully deleted
I20260805 23:05:29.789446 14646 catalog_manager.cc:4841] TS c6f397a4bd944f7e8262ba47daa9c2d8 (127.22.45.65:35601): tablet d431a4b04b7241eda923d31d81bddb3a (table test-table [id=9a3398443be34740bf3e7150f3b1b3b3]) successfully deleted
I20260805 23:05:29.789878 15318 ts_tablet_manager.cc:1905] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:29.797601 15318 ts_tablet_manager.cc:1918] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:29.797845 15318 log.cc:1196] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/d431a4b04b7241eda923d31d81bddb3a
I20260805 23:05:29.798532 15318 ts_tablet_manager.cc:1939] T d431a4b04b7241eda923d31d81bddb3a P f80a0b09f78441b7b0999b8b80c33623: Deleting consensus metadata
I20260805 23:05:29.800803 14647 catalog_manager.cc:4841] TS f80a0b09f78441b7b0999b8b80c33623 (127.22.45.67:43047): tablet d431a4b04b7241eda923d31d81bddb3a (table test-table [id=9a3398443be34740bf3e7150f3b1b3b3]) successfully deleted
I20260805 23:05:29.897384 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 14753
I20260805 23:05:29.918529 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 14936
I20260805 23:05:29.926429 15285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:29.919434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41122 (local address 127.22.45.66:41817)
0805 23:05:29.919658 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:29.919663 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:29.919688 (+ 25us) server_negotiation.cc:407] Connection header received
0805 23:05:29.919857 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:29.919863 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:29.919993 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:29.920100 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:29.920539 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.921395 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.922793 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:29.923473 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:29.923613 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:29.924817 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:29.924827 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:29.924842 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:29.925549 (+ 707us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:29.925612 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:29.925634 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:29.925744 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:29.925903 (+ 159us) server_negotiation.cc:299] Negotiation successful
0805 23:05:29.926026 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 23:05:29.927294 15094 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:30.046936 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 14936
I20260805 23:05:30.071373 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 15104
I20260805 23:05:30.079456 15284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:30.072190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38512 (local address 127.22.45.67:43047)
0805 23:05:30.072401 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:30.072408 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:30.072431 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:05:30.072537 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:30.072542 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:30.072631 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:30.072724 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:30.073185 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:30.073914 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:30.075474 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:30.076035 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:30.076168 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:30.077674 (+ 1506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:30.077685 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:30.077703 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:30.078407 (+ 704us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:30.078466 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:30.078492 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:30.078602 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:30.078910 (+ 308us) server_negotiation.cc:299] Negotiation successful
0805 23:05:30.079105 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260805 23:05:30.080312 15256 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:30.170190 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 15104
I20260805 23:05:30.189133 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 14626
I20260805 23:05:30.190202 14708 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:30.301507 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 14626
2026-08-05T23:05:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3179 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:30 dist-test-slave-1vmg krb5kdc[15329](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:30 dist-test-slave-1vmg krb5kdc[15329](info): set up 2 sockets
Aug 05 23:05:30 dist-test-slave-1vmg krb5kdc[15329](info): commencing operation
krb5kdc: starting...
W20260805 23:05:31.530794 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.004s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:31 dist-test-slave-1vmg krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:05:31.848846 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:40571
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:36107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:40571
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:32.218243 15344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:32.218576 15344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:32.218710 15344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:32.226202 15344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:32.226334 15344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:32.226413 15344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:32.226495 15344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:32.226559 15344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:32.237121 15344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:40571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:40571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:32.238610 15344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:32.240059 15344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:32.252571 15349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:32.252552 15351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:32.253232 15358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:32.253767 15344 server_base.cc:1034] running on GCE node
I20260805 23:05:32.254741 15344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:32.256428 15344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:32.257666 15344 hybrid_clock.cc:648] HybridClock initialized: now 1785971132257605 us; error 55 us; skew 500 ppm
I20260805 23:05:32.258044 15344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:32 dist-test-slave-1vmg krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971132, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:32.261436 15344 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:05:32.263171 15344 webserver.cc:460] Webserver started at http://127.22.45.126:45155/ using document root <none> and password file <none>
I20260805 23:05:32.263932 15344 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:32.264073 15344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:32.264411 15344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:32.267745 15344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1"
format_stamp: "Formatted at 2026-08-05 23:05:32 on dist-test-slave-1vmg"
server_key: "f688040ba2eadcefce7040cd53b24b98"
server_key_iv: "7b5996d5515f22c01191a1961d3e74f5"
server_key_version: "encryptionkey@0"
I20260805 23:05:32.268559 15344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1"
format_stamp: "Formatted at 2026-08-05 23:05:32 on dist-test-slave-1vmg"
server_key: "f688040ba2eadcefce7040cd53b24b98"
server_key_iv: "7b5996d5515f22c01191a1961d3e74f5"
server_key_version: "encryptionkey@0"
I20260805 23:05:32.274128 15344 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260805 23:05:32.277777 15369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:32.279213 15344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:32.279389 15344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1"
format_stamp: "Formatted at 2026-08-05 23:05:32 on dist-test-slave-1vmg"
server_key: "f688040ba2eadcefce7040cd53b24b98"
server_key_iv: "7b5996d5515f22c01191a1961d3e74f5"
server_key_version: "encryptionkey@0"
I20260805 23:05:32.279592 15344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:32.299716 15344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:32.306147 15344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:32.307548 15344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:32.328981 15436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:40571 every 8 connection(s)
I20260805 23:05:32.328986 15344 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:40571
I20260805 23:05:32.331337 15344 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:32.336059 15438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:32.341176 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 15344
I20260805 23:05:32.341390 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:32.341997 22709 external_mini_cluster.cc:1428] Setting key dca22e2188c0f6c5e45a6ae7799861b2
I20260805 23:05:32.351998 15438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1: Bootstrap starting.
I20260805 23:05:32.356096 15438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:32.357497 15438 log.cc:824] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1: Log is configured to *not* fsync() on all Append() calls
Aug 05 23:05:32 dist-test-slave-1vmg krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:32.361349 15438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1: No bootstrap required, opened a new log
I20260805 23:05:32.369545 15445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:32.344826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46936 (local address 127.22.45.126:40571)
0805 23:05:32.345777 (+ 951us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:32.345790 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:32.345835 (+ 45us) server_negotiation.cc:407] Connection header received
0805 23:05:32.347715 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:32.347744 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:32.348242 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:32.348614 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:32.350459 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:32.351838 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:32.353722 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:32.354425 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:32.354556 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:32.359691 (+ 5135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:32.359704 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:32.359739 (+ 35us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:32.359792 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:32.364018 (+ 4226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:32.365142 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:32.365156 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:32.365167 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:32.365429 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:32.365838 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:32.365844 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:32.365847 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:32.366674 (+ 827us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:32.367038 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:32.367493 (+ 455us) server_negotiation.cc:299] Negotiation successful
0805 23:05:32.368010 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":663,"spinlock_wait_cycles":15616,"thread_start_us":542,"threads_started":1}
I20260805 23:05:32.372206 15438 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40571 } }
I20260805 23:05:32.372721 15438 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:32.372824 15438 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd64c1bc80f54cfeb9252cb513fdc3b1, State: Initialized, Role: FOLLOWER
I20260805 23:05:32.373458 15438 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40571 } }
I20260805 23:05:32.373703 15438 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:32.373842 15438 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:32.374002 15438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:32.376533 15438 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40571 } }
I20260805 23:05:32.377116 15438 leader_election.cc:302] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd64c1bc80f54cfeb9252cb513fdc3b1; no voters:
I20260805 23:05:32.377723 15438 leader_election.cc:288] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:32.377861 15448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:32.378571 15448 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [term 1 LEADER]: Becoming Leader. State: Replica: fd64c1bc80f54cfeb9252cb513fdc3b1, State: Running, Role: LEADER
I20260805 23:05:32.379267 15448 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40571 } }
I20260805 23:05:32.379995 15438 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:32.382587 15449 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40571 } } }
I20260805 23:05:32.383047 15449 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:32.383561 15450 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd64c1bc80f54cfeb9252cb513fdc3b1. Latest consensus state: current_term: 1 leader_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd64c1bc80f54cfeb9252cb513fdc3b1" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40571 } } }
I20260805 23:05:32.383877 15450 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:32.384413 15456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:32.390590 15456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:32.403662 15456 catalog_manager.cc:1347] Generated new cluster ID: 7f0cf0a59a834d5dac4aba57bd69619c
I20260805 23:05:32.403827 15456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:32.426769 15456 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:32.428918 15456 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:32.444363 15456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1: Generated new TSK 0
I20260805 23:05:32.445451 15456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:05:32.535167 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:40571
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:36107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:32.903318 15474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:32.903663 15474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:32.903766 15474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:32.911934 15474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:32.912094 15474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:32.912226 15474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:05:32.922678 15474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:40571
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:32.924180 15474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:32.925613 15474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:32.939949 15483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:32.940204 15484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:32.940181 15486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:32.940924 15474 server_base.cc:1034] running on GCE node
I20260805 23:05:32.941660 15474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:32.942735 15474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:32.943964 15474 hybrid_clock.cc:648] HybridClock initialized: now 1785971132943910 us; error 67 us; skew 500 ppm
I20260805 23:05:32.944310 15474 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:32 dist-test-slave-1vmg krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971132, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:32.948063 15474 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:05:32.949803 15474 webserver.cc:460] Webserver started at http://127.22.45.65:33525/ using document root <none> and password file <none>
I20260805 23:05:32.950614 15474 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:32.950753 15474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:32.951175 15474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:32.954454 15474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "13366d588e2c4d6c855ba5e8c8f52690"
format_stamp: "Formatted at 2026-08-05 23:05:32 on dist-test-slave-1vmg"
server_key: "3a7468af39cf50b00fa648b8d6d5e77a"
server_key_iv: "778ae8baa761b614bbc34014f8d426e2"
server_key_version: "encryptionkey@0"
I20260805 23:05:32.955379 15474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "13366d588e2c4d6c855ba5e8c8f52690"
format_stamp: "Formatted at 2026-08-05 23:05:32 on dist-test-slave-1vmg"
server_key: "3a7468af39cf50b00fa648b8d6d5e77a"
server_key_iv: "778ae8baa761b614bbc34014f8d426e2"
server_key_version: "encryptionkey@0"
I20260805 23:05:32.961716 15474 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:05:32.966295 15495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:32.968890 15474 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:05:32.969213 15474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "13366d588e2c4d6c855ba5e8c8f52690"
format_stamp: "Formatted at 2026-08-05 23:05:32 on dist-test-slave-1vmg"
server_key: "3a7468af39cf50b00fa648b8d6d5e77a"
server_key_iv: "778ae8baa761b614bbc34014f8d426e2"
server_key_version: "encryptionkey@0"
I20260805 23:05:32.969530 15474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:32.990207 15474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:32.995313 15474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:32.995609 15474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:32.996662 15474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:32.998324 15474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:32.998411 15474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:32.998509 15474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:32.998554 15474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:33.032351 15474 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:38755
I20260805 23:05:33.032392 15643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:38755 every 8 connection(s)
I20260805 23:05:33.033818 15474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:05:33.038842 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 15474
I20260805 23:05:33.039067 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:05:33.039521 22709 external_mini_cluster.cc:1428] Setting key 105e428513e57a9a258c6292fcffcd50
Aug 05 23:05:33 dist-test-slave-1vmg krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971132, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:33.056263 15649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:33.036739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:49531 (local address 127.22.45.126:40571)
0805 23:05:33.037252 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:33.037257 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:33.038371 (+ 1114us) server_negotiation.cc:407] Connection header received
0805 23:05:33.040531 (+ 2160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:33.040537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:33.040632 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:33.040743 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:33.042648 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.043493 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.045236 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.045689 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.045821 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:33.049889 (+ 4068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:33.049894 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:33.049897 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:33.049938 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:33.052734 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:33.053635 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:33.053640 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:33.053642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:33.053796 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:33.054280 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:33.054284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:33.054286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:33.054592 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:33.054743 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:33.055737 (+ 994us) server_negotiation.cc:299] Negotiation successful
0805 23:05:33.055964 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":242,"threads_started":1}
I20260805 23:05:33.057780 15650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:33.037356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:40571 (local address 127.22.45.65:49531)
0805 23:05:33.038159 (+ 803us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:33.038216 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:33.040200 (+ 1984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:33.041066 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:33.041076 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:33.041746 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:33.042429 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:33.042450 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.043682 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.043686 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:33.045042 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:33.045059 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.045970 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.045978 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:33.046246 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:33.047019 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:33.047053 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:33.049586 (+ 2533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:33.052936 (+ 3350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:33.052949 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:33.052966 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:33.053487 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:33.053918 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:33.053923 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:33.053927 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:33.054149 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:33.054743 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:33.054753 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:33.055231 (+ 478us) client_negotiation.cc:769] Sending connection context
0805 23:05:33.055605 (+ 374us) client_negotiation.cc:240] Negotiation successful
0805 23:05:33.056251 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":543,"thread_start_us":315,"threads_started":1}
I20260805 23:05:33.059782 15644 heartbeater.cc:347] Connected to a master server at 127.22.45.126:40571
I20260805 23:05:33.060164 15644 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:33.061214 15644 heartbeater.cc:511] Master 127.22.45.126:40571 requested a full tablet report, sending...
I20260805 23:05:33.063956 15391 ts_manager.cc:194] Registered new tserver with Master: 13366d588e2c4d6c855ba5e8c8f52690 (127.22.45.65:38755)
I20260805 23:05:33.065614 15391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:49531
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:05:33.110723 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:40571
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:36107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:33.475775 15653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:33.476138 15653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:33.476287 15653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:33.484262 15653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:33.484423 15653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:33.484578 15653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:05:33.495170 15653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:40571
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:33.496644 15653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:33.498095 15653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:33.511869 15663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:33.512163 15659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:33.512488 15660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:33.513223 15653 server_base.cc:1034] running on GCE node
I20260805 23:05:33.513926 15653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:33.515060 15653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:33.516286 15653 hybrid_clock.cc:648] HybridClock initialized: now 1785971133516234 us; error 50 us; skew 500 ppm
I20260805 23:05:33.516633 15653 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:33 dist-test-slave-1vmg krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971133, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:33.520156 15653 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:05:33.521847 15653 webserver.cc:460] Webserver started at http://127.22.45.66:38179/ using document root <none> and password file <none>
I20260805 23:05:33.522611 15653 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:33.522739 15653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:33.523102 15653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:33.526429 15653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "0d7bbefbb9ac40bca324241b46c7b2cc"
format_stamp: "Formatted at 2026-08-05 23:05:33 on dist-test-slave-1vmg"
server_key: "05816167d2633935c6947a1970001fd6"
server_key_iv: "48219bfbd26610a0415cfcf0ba29e7dd"
server_key_version: "encryptionkey@0"
I20260805 23:05:33.527375 15653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "0d7bbefbb9ac40bca324241b46c7b2cc"
format_stamp: "Formatted at 2026-08-05 23:05:33 on dist-test-slave-1vmg"
server_key: "05816167d2633935c6947a1970001fd6"
server_key_iv: "48219bfbd26610a0415cfcf0ba29e7dd"
server_key_version: "encryptionkey@0"
I20260805 23:05:33.533339 15653 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:05:33.537194 15672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:33.538599 15653 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260805 23:05:33.538766 15653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "0d7bbefbb9ac40bca324241b46c7b2cc"
format_stamp: "Formatted at 2026-08-05 23:05:33 on dist-test-slave-1vmg"
server_key: "05816167d2633935c6947a1970001fd6"
server_key_iv: "48219bfbd26610a0415cfcf0ba29e7dd"
server_key_version: "encryptionkey@0"
I20260805 23:05:33.539014 15653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:33.582247 15653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:33.587077 15653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:33.587402 15653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:33.588512 15653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:33.590070 15653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:33.590157 15653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:33.590283 15653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:33.590339 15653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:33.623569 15653 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:36789
I20260805 23:05:33.623596 15836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:36789 every 8 connection(s)
I20260805 23:05:33.624996 15653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:05:33.633810 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 15653
I20260805 23:05:33.634066 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:05:33.634948 22709 external_mini_cluster.cc:1428] Setting key 2fab4b4df849131fecbe50335a2a35fc
Aug 05 23:05:33 dist-test-slave-1vmg krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971133, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:33.650137 15840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:33.627769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:55317 (local address 127.22.45.126:40571)
0805 23:05:33.628242 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:33.628247 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:33.629413 (+ 1166us) server_negotiation.cc:407] Connection header received
0805 23:05:33.631405 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:33.631411 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:33.631500 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:33.631610 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:33.633329 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.634367 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.636811 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.637411 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.637527 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:33.642833 (+ 5306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:33.642840 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:33.642843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:33.642887 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:33.645791 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:33.647025 (+ 1234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:33.647031 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:33.647034 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:33.647187 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:33.647843 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:33.647847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:33.647850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:33.648185 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:33.648350 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:33.649391 (+ 1041us) server_negotiation.cc:299] Negotiation successful
0805 23:05:33.649766 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":255,"threads_started":1}
I20260805 23:05:33.651618 15844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:33.628420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:40571 (local address 127.22.45.66:55317)
0805 23:05:33.629216 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:33.629265 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:33.631088 (+ 1823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:33.631874 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:33.631884 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:33.632500 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:33.633133 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:33.633153 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.634750 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.634757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:33.636618 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:33.636636 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:33.637721 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:33.637731 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:33.638100 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:33.639044 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:33.639083 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:33.642422 (+ 3339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:33.646041 (+ 3619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:33.646054 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:33.646077 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:33.646832 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:33.647305 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:33.647311 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:33.647314 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:33.647649 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:33.648339 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:33.648350 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:33.648898 (+ 548us) client_negotiation.cc:769] Sending connection context
0805 23:05:33.649257 (+ 359us) client_negotiation.cc:240] Negotiation successful
0805 23:05:33.649924 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":315,"threads_started":1}
I20260805 23:05:33.653455 15838 heartbeater.cc:347] Connected to a master server at 127.22.45.126:40571
I20260805 23:05:33.653854 15838 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:33.654857 15838 heartbeater.cc:511] Master 127.22.45.126:40571 requested a full tablet report, sending...
I20260805 23:05:33.657130 15391 ts_manager.cc:194] Registered new tserver with Master: 0d7bbefbb9ac40bca324241b46c7b2cc (127.22.45.66:36789)
I20260805 23:05:33.658080 15391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:55317
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:05:33.706738 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:40571
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:36107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:05:34.070236 15644 heartbeater.cc:503] Master 127.22.45.126:40571 was elected leader, sending a full tablet report...
W20260805 23:05:34.074771 15847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:34.075188 15847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:34.075314 15847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:34.083216 15847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:34.083364 15847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:34.083523 15847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:05:34.094046 15847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:40571
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:34.095530 15847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:34.096925 15847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:34.111392 15855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:34.111426 15853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:34.111469 15852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:34.112249 15847 server_base.cc:1034] running on GCE node
I20260805 23:05:34.112929 15847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:34.114034 15847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:34.115263 15847 hybrid_clock.cc:648] HybridClock initialized: now 1785971134115193 us; error 63 us; skew 500 ppm
I20260805 23:05:34.115628 15847 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:34 dist-test-slave-1vmg krb5kdc[15329](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971134, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:34.119330 15847 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:05:34.121215 15847 webserver.cc:460] Webserver started at http://127.22.45.67:41413/ using document root <none> and password file <none>
I20260805 23:05:34.122020 15847 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:34.122144 15847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:34.122503 15847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:34.126099 15847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "b11e4206297f4c0aba765dcd200ddf7d"
format_stamp: "Formatted at 2026-08-05 23:05:34 on dist-test-slave-1vmg"
server_key: "4407a1a721c3754e5c602c1dcdfd322f"
server_key_iv: "10354f6768dea90ab0903df13d6d2908"
server_key_version: "encryptionkey@0"
I20260805 23:05:34.127076 15847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "b11e4206297f4c0aba765dcd200ddf7d"
format_stamp: "Formatted at 2026-08-05 23:05:34 on dist-test-slave-1vmg"
server_key: "4407a1a721c3754e5c602c1dcdfd322f"
server_key_iv: "10354f6768dea90ab0903df13d6d2908"
server_key_version: "encryptionkey@0"
I20260805 23:05:34.133092 15847 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:05:34.137596 15863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:34.139430 15847 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:05:34.139621 15847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "b11e4206297f4c0aba765dcd200ddf7d"
format_stamp: "Formatted at 2026-08-05 23:05:34 on dist-test-slave-1vmg"
server_key: "4407a1a721c3754e5c602c1dcdfd322f"
server_key_iv: "10354f6768dea90ab0903df13d6d2908"
server_key_version: "encryptionkey@0"
I20260805 23:05:34.139865 15847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:34.159328 15847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:34.164151 15847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:34.164477 15847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:34.165580 15847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:34.167232 15847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:34.167321 15847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:34.167447 15847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:34.167500 15847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:34.200459 15847 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:32991
I20260805 23:05:34.200500 16025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:32991 every 8 connection(s)
I20260805 23:05:34.201886 15847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:05:34.208858 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 15847
I20260805 23:05:34.209059 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:05:34.209497 22709 external_mini_cluster.cc:1428] Setting key 6e2d8b8d0be95f64764a0637e7d71805
Aug 05 23:05:34 dist-test-slave-1vmg krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971134, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:34.223272 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.204697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:42639 (local address 127.22.45.126:40571)
0805 23:05:34.205151 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.205156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.206131 (+ 975us) server_negotiation.cc:407] Connection header received
0805 23:05:34.208114 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.208120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.208221 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.208323 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:34.210228 (+ 1905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.211411 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.213302 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.213721 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.213826 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.217641 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:34.217646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:34.217650 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:34.217689 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:34.220399 (+ 2710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.221162 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.221166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.221168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.221307 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.221669 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.221672 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.221673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.221956 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:34.222076 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.222745 (+ 669us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.222971 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":233,"threads_started":1}
I20260805 23:05:34.224591 16031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.205181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:40571 (local address 127.22.45.67:42639)
0805 23:05:34.205948 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:34.205998 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:34.207805 (+ 1807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:34.208594 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:34.208603 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:34.209259 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:34.209976 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.210004 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.211564 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.211568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.213158 (+ 1590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.213174 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.213986 (+ 812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.213993 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.214218 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.214951 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:34.214993 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:34.217370 (+ 2377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:34.220555 (+ 3185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:34.220564 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:34.220581 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:34.221063 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:34.221389 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:34.221392 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:34.221395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:34.221589 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:34.222054 (+ 465us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:34.222060 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:34.222424 (+ 364us) client_negotiation.cc:769] Sending connection context
0805 23:05:34.222676 (+ 252us) client_negotiation.cc:240] Negotiation successful
0805 23:05:34.223244 (+ 568us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":286,"threads_started":1}
I20260805 23:05:34.225986 16026 heartbeater.cc:347] Connected to a master server at 127.22.45.126:40571
I20260805 23:05:34.226305 16026 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:34.227102 16026 heartbeater.cc:511] Master 127.22.45.126:40571 requested a full tablet report, sending...
I20260805 23:05:34.228582 15391 ts_manager.cc:194] Registered new tserver with Master: b11e4206297f4c0aba765dcd200ddf7d (127.22.45.67:32991)
I20260805 23:05:34.229418 15391 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:42639
I20260805 23:05:34.238135 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:05:34.256908 16028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.242712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46946 (local address 127.22.45.126:40571)
0805 23:05:34.242966 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.242973 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.243364 (+ 391us) server_negotiation.cc:407] Connection header received
0805 23:05:34.243656 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.243663 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.243738 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.243827 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:34.245478 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.246218 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.247683 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.248138 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.248254 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.251342 (+ 3088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:34.251347 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:34.251351 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:34.251394 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:34.254052 (+ 2658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.255011 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.255015 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.255017 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.255160 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.255556 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.255559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.255561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.255890 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:34.256098 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.256478 (+ 380us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.256642 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 23:05:34.261629 15391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46946:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:05:34.269605 15391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:05:34.293282 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.283479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43654 (local address 127.22.45.65:38755)
0805 23:05:34.284636 (+ 1157us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.284643 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.284666 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:05:34.284747 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.284753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.285011 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.285893 (+ 882us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:34.286083 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.287598 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.290242 (+ 2644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.291657 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.291797 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.292042 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.292736 (+ 694us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.292928 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1012,"thread_start_us":857,"threads_started":1}
I20260805 23:05:34.293279 16044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.283335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:38755 (local address 127.0.0.1:43654)
0805 23:05:34.284181 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:34.284230 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:34.284404 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:34.285272 (+ 868us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:34.285280 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:34.285318 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:34.285723 (+ 405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.285735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.287725 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.287730 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.290027 (+ 2297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.290043 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.292196 (+ 2153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.292203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.292437 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.292500 (+ 63us) client_negotiation.cc:769] Sending connection context
0805 23:05:34.292656 (+ 156us) client_negotiation.cc:240] Negotiation successful
0805 23:05:34.292863 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":432,"threads_started":1}
I20260805 23:05:34.293996 16046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.284577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:32991 (local address 127.0.0.1:39948)
0805 23:05:34.285168 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:34.285186 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:34.285289 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:34.286493 (+ 1204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:34.286498 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:34.286526 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:34.287016 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.287030 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.289104 (+ 2074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.289109 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.291317 (+ 2208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.291333 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.293112 (+ 1779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.293117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.293345 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.293380 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:05:34.293466 (+ 86us) client_negotiation.cc:240] Negotiation successful
0805 23:05:34.293598 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"mutex_wait_us":41,"thread_start_us":338,"threads_started":1}
I20260805 23:05:34.294381 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.285021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39948 (local address 127.22.45.67:32991)
0805 23:05:34.285888 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.285896 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.285927 (+ 31us) server_negotiation.cc:407] Connection header received
0805 23:05:34.286023 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.286030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.286280 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.287229 (+ 949us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:34.287506 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.288969 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.291493 (+ 2524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.292881 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.293264 (+ 383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.293802 (+ 538us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.293878 (+ 76us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.294038 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":482,"threads_started":1}
I20260805 23:05:34.297345 16048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.285253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36789 (local address 127.0.0.1:46608)
0805 23:05:34.288187 (+ 2934us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:34.288206 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:34.288310 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:34.289376 (+ 1066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:34.289380 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:34.289413 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:34.289948 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.289965 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.291854 (+ 1889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.291860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.294744 (+ 2884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.294763 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.296513 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.296520 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.296688 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.296713 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 23:05:34.296800 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 23:05:34.296941 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2809,"mutex_wait_us":48,"thread_start_us":2650,"threads_started":1}
I20260805 23:05:34.297358 16049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.285828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46608 (local address 127.22.45.66:36789)
0805 23:05:34.288820 (+ 2992us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.288828 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.288856 (+ 28us) server_negotiation.cc:407] Connection header received
0805 23:05:34.288946 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.288954 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.289180 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.289366 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:34.290185 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.291677 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.294995 (+ 3318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.296294 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.296429 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.296626 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.296870 (+ 244us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.297044 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2821,"thread_start_us":2701,"threads_started":1}
I20260805 23:05:34.298010 15556 tablet_service.cc:1467] Processing CreateTablet for tablet 07040e61a371421fbfa28842965df014 (DEFAULT_TABLE table=test-table [id=1e796e4f92a0445fa00ba9a21f844da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:34.298010 15936 tablet_service.cc:1467] Processing CreateTablet for tablet 07040e61a371421fbfa28842965df014 (DEFAULT_TABLE table=test-table [id=1e796e4f92a0445fa00ba9a21f844da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:34.299758 15556 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07040e61a371421fbfa28842965df014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:34.299763 15936 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07040e61a371421fbfa28842965df014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:34.301177 15743 tablet_service.cc:1467] Processing CreateTablet for tablet 07040e61a371421fbfa28842965df014 (DEFAULT_TABLE table=test-table [id=1e796e4f92a0445fa00ba9a21f844da2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:34.302469 15743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07040e61a371421fbfa28842965df014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:34.316807 16050 tablet_bootstrap.cc:492] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Bootstrap starting.
I20260805 23:05:34.319298 16052 tablet_bootstrap.cc:492] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Bootstrap starting.
I20260805 23:05:34.320873 16051 tablet_bootstrap.cc:492] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Bootstrap starting.
I20260805 23:05:34.321404 16050 tablet_bootstrap.cc:654] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:34.322962 16050 log.cc:824] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:34.323632 16052 tablet_bootstrap.cc:654] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:34.324036 16051 tablet_bootstrap.cc:654] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:34.325249 16052 log.cc:824] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:34.325304 16051 log.cc:824] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:34.328850 16052 tablet_bootstrap.cc:492] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: No bootstrap required, opened a new log
I20260805 23:05:34.328900 16051 tablet_bootstrap.cc:492] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: No bootstrap required, opened a new log
I20260805 23:05:34.329228 16052 ts_tablet_manager.cc:1397] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260805 23:05:34.329226 16051 ts_tablet_manager.cc:1397] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260805 23:05:34.329674 16050 tablet_bootstrap.cc:492] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: No bootstrap required, opened a new log
I20260805 23:05:34.329970 16050 ts_tablet_manager.cc:1397] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.000s
I20260805 23:05:34.340678 16051 raft_consensus.cc:348] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.341282 16051 raft_consensus.cc:374] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:34.341060 16050 raft_consensus.cc:348] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.341413 16051 raft_consensus.cc:729] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13366d588e2c4d6c855ba5e8c8f52690, State: Initialized, Role: FOLLOWER
I20260805 23:05:34.341542 16050 raft_consensus.cc:374] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:34.341641 16050 raft_consensus.cc:729] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d7bbefbb9ac40bca324241b46c7b2cc, State: Initialized, Role: FOLLOWER
I20260805 23:05:34.342295 16050 consensus_queue.cc:260] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.342295 16051 consensus_queue.cc:260] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.342890 16052 raft_consensus.cc:348] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.343519 16052 raft_consensus.cc:374] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:34.343662 16052 raft_consensus.cc:729] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b11e4206297f4c0aba765dcd200ddf7d, State: Initialized, Role: FOLLOWER
I20260805 23:05:34.344442 16052 consensus_queue.cc:260] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.350800 16050 ts_tablet_manager.cc:1428] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Time spent starting tablet: real 0.021s user 0.017s sys 0.004s
I20260805 23:05:34.351294 16051 ts_tablet_manager.cc:1428] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Time spent starting tablet: real 0.022s user 0.017s sys 0.004s
I20260805 23:05:34.351393 16026 heartbeater.cc:503] Master 127.22.45.126:40571 was elected leader, sending a full tablet report...
I20260805 23:05:34.352286 16052 ts_tablet_manager.cc:1428] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Time spent starting tablet: real 0.023s user 0.010s sys 0.007s
I20260805 23:05:34.353016 15838 heartbeater.cc:503] Master 127.22.45.126:40571 was elected leader, sending a full tablet report...
W20260805 23:05:34.377154 15839 tablet.cc:2369] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:34.425879 16058 raft_consensus.cc:482] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:05:34.426239 16058 raft_consensus.cc:504] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.428131 16058 leader_election.cc:288] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b11e4206297f4c0aba765dcd200ddf7d (127.22.45.67:32991), 0d7bbefbb9ac40bca324241b46c7b2cc (127.22.45.66:36789)
I20260805 23:05:34.435791 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.428709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:33679 (local address 127.22.45.67:32991)
0805 23:05:34.428966 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.428973 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.429364 (+ 391us) server_negotiation.cc:407] Connection header received
0805 23:05:34.429645 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.429651 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.429752 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.429854 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:34.430575 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.431598 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.433763 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.434651 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.434816 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.434882 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.435347 (+ 465us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.435505 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 23:05:34.435832 16049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.429637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:35871 (local address 127.22.45.66:36789)
0805 23:05:34.429890 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.429896 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.430193 (+ 297us) server_negotiation.cc:407] Connection header received
0805 23:05:34.430348 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.430354 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.430437 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.430529 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:34.431158 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.432013 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.433959 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.434829 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.435024 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.435102 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.435433 (+ 331us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.435579 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115}
I20260805 23:05:34.435981 16061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.429420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:36789 (local address 127.22.45.65:35871)
0805 23:05:34.430079 (+ 659us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:34.430097 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:34.430222 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:34.430564 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:34.430568 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:34.430594 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:34.431004 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.431018 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.432175 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.432179 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.433756 (+ 1577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.433773 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.435103 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.435107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.435244 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.435277 (+ 33us) client_negotiation.cc:769] Sending connection context
0805 23:05:34.435379 (+ 102us) client_negotiation.cc:240] Negotiation successful
0805 23:05:34.435509 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"mutex_wait_us":25,"thread_start_us":316,"threads_started":1}
I20260805 23:05:34.435953 16060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.428600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:32991 (local address 127.22.45.65:33679)
0805 23:05:34.429228 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:34.429247 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:34.429420 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:34.429964 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:34.429968 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:34.429997 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:34.430392 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.430407 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.431759 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.431765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.433528 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:34.433545 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.434906 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.434936 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:34.435151 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.435180 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 23:05:34.435274 (+ 94us) client_negotiation.cc:240] Negotiation successful
0805 23:05:34.435414 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":1,"thread_start_us":332,"threads_started":1}
I20260805 23:05:34.437225 15772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07040e61a371421fbfa28842965df014" candidate_uuid: "13366d588e2c4d6c855ba5e8c8f52690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" is_pre_election: true
I20260805 23:05:34.437211 15968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07040e61a371421fbfa28842965df014" candidate_uuid: "13366d588e2c4d6c855ba5e8c8f52690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b11e4206297f4c0aba765dcd200ddf7d" is_pre_election: true
I20260805 23:05:34.437871 15968 raft_consensus.cc:2454] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13366d588e2c4d6c855ba5e8c8f52690 in term 0.
I20260805 23:05:34.437872 15772 raft_consensus.cc:2454] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13366d588e2c4d6c855ba5e8c8f52690 in term 0.
I20260805 23:05:34.438688 15496 leader_election.cc:302] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7bbefbb9ac40bca324241b46c7b2cc, 13366d588e2c4d6c855ba5e8c8f52690; no voters:
I20260805 23:05:34.439177 16058 raft_consensus.cc:2781] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:05:34.439363 16058 raft_consensus.cc:482] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:05:34.439471 16058 raft_consensus.cc:3037] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:34.442123 16058 raft_consensus.cc:504] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
I20260805 23:05:34.442842 16058 leader_election.cc:288] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [CANDIDATE]: Term 1 election: Requested vote from peers b11e4206297f4c0aba765dcd200ddf7d (127.22.45.67:32991), 0d7bbefbb9ac40bca324241b46c7b2cc (127.22.45.66:36789)
I20260805 23:05:34.443542 15968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07040e61a371421fbfa28842965df014" candidate_uuid: "13366d588e2c4d6c855ba5e8c8f52690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b11e4206297f4c0aba765dcd200ddf7d"
I20260805 23:05:34.443599 15772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07040e61a371421fbfa28842965df014" candidate_uuid: "13366d588e2c4d6c855ba5e8c8f52690" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc"
I20260805 23:05:34.443789 15968 raft_consensus.cc:3037] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:34.443818 15772 raft_consensus.cc:3037] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:34.446295 15772 raft_consensus.cc:2454] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13366d588e2c4d6c855ba5e8c8f52690 in term 1.
I20260805 23:05:34.446295 15968 raft_consensus.cc:2454] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13366d588e2c4d6c855ba5e8c8f52690 in term 1.
I20260805 23:05:34.446835 15496 leader_election.cc:302] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d7bbefbb9ac40bca324241b46c7b2cc, 13366d588e2c4d6c855ba5e8c8f52690; no voters:
I20260805 23:05:34.447201 16058 raft_consensus.cc:2781] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:34.447714 16058 raft_consensus.cc:686] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 1 LEADER]: Becoming Leader. State: Replica: 13366d588e2c4d6c855ba5e8c8f52690, State: Running, Role: LEADER
I20260805 23:05:34.448242 16058 consensus_queue.cc:237] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } }
W20260805 23:05:34.453676 16027 tablet.cc:2369] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:34.453656 15387 catalog_manager.cc:5495] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13366d588e2c4d6c855ba5e8c8f52690 (127.22.45.65). New cstate: current_term: 1 leader_uuid: "13366d588e2c4d6c855ba5e8c8f52690" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13366d588e2c4d6c855ba5e8c8f52690" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 38755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 } health_report { overall_health: UNKNOWN } } }
I20260805 23:05:34.492252 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.486437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43662 (local address 127.22.45.65:38755)
0805 23:05:34.486653 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.486658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.486701 (+ 43us) server_negotiation.cc:407] Connection header received
0805 23:05:34.486935 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.486941 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.487078 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.487229 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:05:34.487700 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.488457 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.489972 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.490394 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.490499 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.491032 (+ 533us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:05:34.491605 (+ 573us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:05:34.491750 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.491919 (+ 169us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.491970 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 23:05:34.502024 15968 raft_consensus.cc:1261] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 1 FOLLOWER]: Refusing update from remote peer 13366d588e2c4d6c855ba5e8c8f52690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:34.502022 15772 raft_consensus.cc:1261] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 1 FOLLOWER]: Refusing update from remote peer 13366d588e2c4d6c855ba5e8c8f52690: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:34.503233 16058 consensus_queue.cc:1035] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b11e4206297f4c0aba765dcd200ddf7d" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 32991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:34.503621 16062 consensus_queue.cc:1035] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d7bbefbb9ac40bca324241b46c7b2cc" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:34.515982 16069 mvcc.cc:205] Tried to move back new op lower bound from 7315337766907510784 to 7315337766704025600. Current Snapshot: MvccSnapshot[applied={T|T < 7315337766907510784}]
I20260805 23:05:34.521714 16072 mvcc.cc:205] Tried to move back new op lower bound from 7315337766907510784 to 7315337766704025600. Current Snapshot: MvccSnapshot[applied={T|T < 7315337766907510784}]
I20260805 23:05:34.533007 16071 mvcc.cc:205] Tried to move back new op lower bound from 7315337766907510784 to 7315337766704025600. Current Snapshot: MvccSnapshot[applied={T|T < 7315337766907510784}]
I20260805 23:05:34.543570 15386 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:34.543985 15386 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46946:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:34.548846 15386 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fd64c1bc80f54cfeb9252cb513fdc3b1: Sending DeleteTablet for 3 replicas of tablet 07040e61a371421fbfa28842965df014
I20260805 23:05:34.550259 15556 tablet_service.cc:1514] Processing DeleteTablet for tablet 07040e61a371421fbfa28842965df014 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:34 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:43654
I20260805 23:05:34.550417 15936 tablet_service.cc:1514] Processing DeleteTablet for tablet 07040e61a371421fbfa28842965df014 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:34 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:39948
I20260805 23:05:34.550418 15743 tablet_service.cc:1514] Processing DeleteTablet for tablet 07040e61a371421fbfa28842965df014 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:34 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:46608
I20260805 23:05:34.553020 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 15474
I20260805 23:05:34.562603 16088 tablet_replica.cc:330] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: stopping tablet replica
I20260805 23:05:34.563441 16088 raft_consensus.cc:2229] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:34.564179 16088 raft_consensus.cc:2258] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:34.567178 16088 ts_tablet_manager.cc:1905] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:34.570827 16082 tablet_replica.cc:330] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: stopping tablet replica
I20260805 23:05:34.572731 16086 tablet_replica.cc:330] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: stopping tablet replica
I20260805 23:05:34.573099 16082 raft_consensus.cc:2229] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:05:34.573210 16086 raft_consensus.cc:2229] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:34.573825 16086 raft_consensus.cc:2258] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:34.576311 16088 ts_tablet_manager.cc:1918] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:34.576400 16086 ts_tablet_manager.cc:1905] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:34.576160 16082 raft_consensus.cc:2258] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:34.576619 16088 log.cc:1196] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/07040e61a371421fbfa28842965df014
I20260805 23:05:34.577255 16088 ts_tablet_manager.cc:1939] T 07040e61a371421fbfa28842965df014 P 0d7bbefbb9ac40bca324241b46c7b2cc: Deleting consensus metadata
I20260805 23:05:34.580044 15370 catalog_manager.cc:4841] TS 0d7bbefbb9ac40bca324241b46c7b2cc (127.22.45.66:36789): tablet 07040e61a371421fbfa28842965df014 (table test-table [id=1e796e4f92a0445fa00ba9a21f844da2]) successfully deleted
Aug 05 23:05:34 dist-test-slave-1vmg krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:05:34.582621 16082 ts_tablet_manager.cc:1905] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:34.584479 16086 ts_tablet_manager.cc:1918] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:34.584729 16086 log.cc:1196] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/07040e61a371421fbfa28842965df014
I20260805 23:05:34.585448 16086 ts_tablet_manager.cc:1939] T 07040e61a371421fbfa28842965df014 P b11e4206297f4c0aba765dcd200ddf7d: Deleting consensus metadata
I20260805 23:05:34.587738 15370 catalog_manager.cc:4841] TS b11e4206297f4c0aba765dcd200ddf7d (127.22.45.67:32991): tablet 07040e61a371421fbfa28842965df014 (table test-table [id=1e796e4f92a0445fa00ba9a21f844da2]) successfully deleted
I20260805 23:05:34.591579 16082 ts_tablet_manager.cc:1918] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:34.591915 16045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.554031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43674 (local address 127.22.45.65:38755)
0805 23:05:34.554261 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.554269 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.561263 (+ 6994us) server_negotiation.cc:407] Connection header received
0805 23:05:34.562413 (+ 1150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.562420 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.562520 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.562614 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:34.567076 (+ 4462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.568433 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.573433 (+ 5000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.574183 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.574334 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.583731 (+ 9397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:34.583748 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:34.583771 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:34.583821 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:34.588512 (+ 4691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.589415 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.589426 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.589429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.589627 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.590070 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.590075 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.590077 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.590491 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:34.590836 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.591198 (+ 362us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.591471 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:05:34.591922 16082 log.cc:1196] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/07040e61a371421fbfa28842965df014
I20260805 23:05:34.592585 16082 ts_tablet_manager.cc:1939] T 07040e61a371421fbfa28842965df014 P 13366d588e2c4d6c855ba5e8c8f52690: Deleting consensus metadata
I20260805 23:05:34.592638 15639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:34.705999 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 15474
I20260805 23:05:34.706117 15370 catalog_manager.cc:4841] TS 13366d588e2c4d6c855ba5e8c8f52690 (127.22.45.65:38755): tablet 07040e61a371421fbfa28842965df014 (table test-table [id=1e796e4f92a0445fa00ba9a21f844da2]) successfully deleted
I20260805 23:05:34.729331 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 15653
Aug 05 23:05:34 dist-test-slave-1vmg krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:05:34.745595 16049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.730112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51098 (local address 127.22.45.66:36789)
0805 23:05:34.730317 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.730323 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.730345 (+ 22us) server_negotiation.cc:407] Connection header received
0805 23:05:34.730501 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.730506 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.730587 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.730674 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:34.732098 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.732889 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.734274 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.734678 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.734799 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.739394 (+ 4595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:34.739415 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:34.739433 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:34.739477 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:34.742340 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.743487 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.743497 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.743499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.743658 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.744038 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.744043 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.744046 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.744577 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:34.744831 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.745097 (+ 266us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.745325 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:05:34.746294 15832 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:34.837245 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 15653
I20260805 23:05:34.858806 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 15847
Aug 05 23:05:34 dist-test-slave-1vmg krb5kdc[15329](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:05:34.880108 16047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:34.859719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46532 (local address 127.22.45.67:32991)
0805 23:05:34.859933 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:34.859939 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:34.859962 (+ 23us) server_negotiation.cc:407] Connection header received
0805 23:05:34.860107 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:34.860112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:34.860179 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:34.860293 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:34.861693 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.862448 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.863970 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:34.864399 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:34.864525 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:34.873922 (+ 9397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:34.873943 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:34.873960 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:34.874007 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:34.876882 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.877773 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.877782 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.877785 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.877962 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:34.878372 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:34.878376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:34.878378 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:34.878792 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:34.879145 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:34.879478 (+ 333us) server_negotiation.cc:299] Negotiation successful
0805 23:05:34.879765 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260805 23:05:34.880895 16021 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:34.971868 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 15847
I20260805 23:05:34.990008 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 15344
I20260805 23:05:34.991261 15432 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:35.105242 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 15344
2026-08-05T23:05:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4806 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-05T23:05:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:35Z Disabled control of system clock
I20260805 23:05:35.204504 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:42941
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:38367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:42941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 23:05:35.574462 16098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:35.574841 16098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:35.574970 16098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:35.582724 16098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:35.582881 16098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:35.582971 16098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:35.583057 16098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:35.583105 16098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:35.592823 16098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:42941
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:42941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:35.594234 16098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:35.596153 16098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:35.608757 16107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:35.608865 16110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:35.608891 16104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:35.609814 16098 server_base.cc:1034] running on GCE node
I20260805 23:05:35.610671 16098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:35.612309 16098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:35.613528 16098 hybrid_clock.cc:648] HybridClock initialized: now 1785971135613479 us; error 37 us; skew 500 ppm
I20260805 23:05:35.613893 16098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:35.616413 16098 webserver.cc:460] Webserver started at http://127.22.45.126:40155/ using document root <none> and password file <none>
I20260805 23:05:35.617183 16098 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:35.617309 16098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:35.617635 16098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:35.621031 16098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "5b1151acdf33432f9b17caa36679c2a0"
format_stamp: "Formatted at 2026-08-05 23:05:35 on dist-test-slave-1vmg"
server_key: "6349f992c5e8641ca11e1beb459c6690"
server_key_iv: "3a9c0b2374af7378a96c16283f73b6a9"
server_key_version: "encryptionkey@0"
I20260805 23:05:35.621958 16098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "5b1151acdf33432f9b17caa36679c2a0"
format_stamp: "Formatted at 2026-08-05 23:05:35 on dist-test-slave-1vmg"
server_key: "6349f992c5e8641ca11e1beb459c6690"
server_key_iv: "3a9c0b2374af7378a96c16283f73b6a9"
server_key_version: "encryptionkey@0"
I20260805 23:05:35.628443 16098 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260805 23:05:35.632572 16118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:35.634209 16098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:05:35.634424 16098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "5b1151acdf33432f9b17caa36679c2a0"
format_stamp: "Formatted at 2026-08-05 23:05:35 on dist-test-slave-1vmg"
server_key: "6349f992c5e8641ca11e1beb459c6690"
server_key_iv: "3a9c0b2374af7378a96c16283f73b6a9"
server_key_version: "encryptionkey@0"
I20260805 23:05:35.634681 16098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:35.687970 16098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:35.689213 16098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:35.689576 16098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:35.709363 16098 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:42941
I20260805 23:05:35.709384 16185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:42941 every 8 connection(s)
I20260805 23:05:35.711004 16098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:35.715387 16186 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:35.717170 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 16098
I20260805 23:05:35.717365 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:35.717828 22709 external_mini_cluster.cc:1428] Setting key 4963d3b8efc24e368b3431c16fb64cba
I20260805 23:05:35.730372 16186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0: Bootstrap starting.
I20260805 23:05:35.734730 16186 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:35.735809 16191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:35.720128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32820 (local address 127.22.45.126:42941)
0805 23:05:35.721489 (+ 1361us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:35.721522 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:35.721589 (+ 67us) server_negotiation.cc:407] Connection header received
0805 23:05:35.724201 (+ 2612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:35.724237 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:35.724935 (+ 698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:35.725441 (+ 506us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:35.726057 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:35.728222 (+ 2165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:35.730007 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:35.731163 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:35.731361 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:35.732592 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:35.732603 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:35.732624 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:35.733426 (+ 802us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:35.733543 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:35.733577 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:35.733706 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:35.733953 (+ 247us) server_negotiation.cc:299] Negotiation successful
0805 23:05:35.734332 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":435,"threads_started":1}
I20260805 23:05:35.736186 16186 log.cc:824] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:35.739822 16186 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0: No bootstrap required, opened a new log
I20260805 23:05:35.748035 16186 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1151acdf33432f9b17caa36679c2a0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42941 } }
I20260805 23:05:35.748557 16186 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:35.748704 16186 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b1151acdf33432f9b17caa36679c2a0, State: Initialized, Role: FOLLOWER
I20260805 23:05:35.749406 16186 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1151acdf33432f9b17caa36679c2a0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42941 } }
I20260805 23:05:35.749655 16186 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:35.749763 16186 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:35.749894 16186 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:35.752214 16186 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1151acdf33432f9b17caa36679c2a0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42941 } }
I20260805 23:05:35.752796 16186 leader_election.cc:302] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b1151acdf33432f9b17caa36679c2a0; no voters:
I20260805 23:05:35.753415 16186 leader_election.cc:288] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:35.753571 16193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:35.754330 16193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [term 1 LEADER]: Becoming Leader. State: Replica: 5b1151acdf33432f9b17caa36679c2a0, State: Running, Role: LEADER
I20260805 23:05:35.754961 16193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1151acdf33432f9b17caa36679c2a0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42941 } }
I20260805 23:05:35.755894 16186 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:35.758358 16194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b1151acdf33432f9b17caa36679c2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1151acdf33432f9b17caa36679c2a0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42941 } } }
I20260805 23:05:35.758878 16194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:35.758335 16195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b1151acdf33432f9b17caa36679c2a0. Latest consensus state: current_term: 1 leader_uuid: "5b1151acdf33432f9b17caa36679c2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b1151acdf33432f9b17caa36679c2a0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 42941 } } }
I20260805 23:05:35.759300 16195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:35.763221 16204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:35.768239 16204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:35.778301 16204 catalog_manager.cc:1347] Generated new cluster ID: 4321c123eae04e058e9ef401cc31184a
I20260805 23:05:35.778453 16204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:35.792340 16204 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:35.793821 16204 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:35.805485 16204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0: Generated new TSK 0
I20260805 23:05:35.806736 16204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:35.817548 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42941
--builtin_ntp_servers=127.22.45.84:38367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 23:05:36.197054 16220 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:36.197407 16220 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:36.197546 16220 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:36.205451 16220 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:36.205572 16220 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:36.205725 16220 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:05:36.215533 16220 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:36.216926 16220 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:36.218886 16220 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:36.232959 16225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:36.233024 16229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:36.233743 16227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:36.233783 16220 server_base.cc:1034] running on GCE node
I20260805 23:05:36.234658 16220 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:36.235833 16220 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:36.237073 16220 hybrid_clock.cc:648] HybridClock initialized: now 1785971136237019 us; error 49 us; skew 500 ppm
I20260805 23:05:36.237418 16220 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:36.240284 16220 webserver.cc:460] Webserver started at http://127.22.45.65:46819/ using document root <none> and password file <none>
I20260805 23:05:36.241053 16220 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:36.241155 16220 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:36.241467 16220 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:36.244796 16220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "69616d61e369471794ea59f4a506c54e"
format_stamp: "Formatted at 2026-08-05 23:05:36 on dist-test-slave-1vmg"
server_key: "3dd9542e40b3a5942e1e497492d46721"
server_key_iv: "5b374ad2d9084ca78ddbf371eb0bfce0"
server_key_version: "encryptionkey@0"
I20260805 23:05:36.245766 16220 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "69616d61e369471794ea59f4a506c54e"
format_stamp: "Formatted at 2026-08-05 23:05:36 on dist-test-slave-1vmg"
server_key: "3dd9542e40b3a5942e1e497492d46721"
server_key_iv: "5b374ad2d9084ca78ddbf371eb0bfce0"
server_key_version: "encryptionkey@0"
I20260805 23:05:36.252166 16220 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260805 23:05:36.256557 16242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:36.258225 16220 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:05:36.258424 16220 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "69616d61e369471794ea59f4a506c54e"
format_stamp: "Formatted at 2026-08-05 23:05:36 on dist-test-slave-1vmg"
server_key: "3dd9542e40b3a5942e1e497492d46721"
server_key_iv: "5b374ad2d9084ca78ddbf371eb0bfce0"
server_key_version: "encryptionkey@0"
I20260805 23:05:36.258661 16220 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:36.274991 16220 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:36.275959 16220 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:36.276283 16220 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:36.277370 16220 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:36.279117 16220 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:36.279235 16220 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:36.279353 16220 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:36.279433 16220 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:36.311913 16220 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:45327
I20260805 23:05:36.311959 16388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:45327 every 8 connection(s)
I20260805 23:05:36.313249 16220 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:05:36.321324 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 16220
I20260805 23:05:36.321514 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:05:36.322088 22709 external_mini_cluster.cc:1428] Setting key 17f37e046a998fbe0434635eb8fe4d0b
I20260805 23:05:36.325433 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42941
--builtin_ntp_servers=127.22.45.84:38367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 23:05:36.327214 16391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:36.315864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:53151 (local address 127.22.45.126:42941)
0805 23:05:36.316290 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:36.316295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:36.317501 (+ 1206us) server_negotiation.cc:407] Connection header received
0805 23:05:36.319395 (+ 1894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:36.319402 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:36.319505 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:36.319607 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:36.320810 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.321881 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.323777 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.324328 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.324443 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:36.326340 (+ 1897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:36.326346 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:36.326349 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:36.326372 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:36.326417 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:36.326430 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:36.326506 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:36.326779 (+ 273us) server_negotiation.cc:299] Negotiation successful
0805 23:05:36.326879 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":322,"thread_start_us":210,"threads_started":1}
I20260805 23:05:36.328773 16392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:36.316447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:42941 (local address 127.22.45.65:53151)
0805 23:05:36.317341 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:36.317384 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:36.319088 (+ 1704us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:36.319893 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:36.319902 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:36.320005 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:36.320622 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:36.320640 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.322074 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.322078 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:36.323609 (+ 1531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:36.323623 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.324625 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.324634 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:36.324990 (+ 356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:36.325894 (+ 904us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:36.325897 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:36.325962 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:36.326090 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:36.326531 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:36.326544 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:36.326553 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 23:05:36.326769 (+ 216us) client_negotiation.cc:240] Negotiation successful
0805 23:05:36.327316 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":272,"threads_started":1}
I20260805 23:05:36.330478 16389 heartbeater.cc:347] Connected to a master server at 127.22.45.126:42941
I20260805 23:05:36.330817 16389 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:36.331715 16389 heartbeater.cc:511] Master 127.22.45.126:42941 requested a full tablet report, sending...
I20260805 23:05:36.333983 16141 ts_manager.cc:194] Registered new tserver with Master: 69616d61e369471794ea59f4a506c54e (127.22.45.65:45327)
I20260805 23:05:36.335628 16141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.65:53151
W20260805 23:05:36.686508 16393 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:36.686859 16393 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:36.687013 16393 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:36.694567 16393 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:36.694727 16393 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:36.694871 16393 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:05:36.704813 16393 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:36.706256 16393 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:36.708205 16393 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:36.722420 16399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:36.722426 16401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:36.723721 16403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:36.726130 16393 server_base.cc:1034] running on GCE node
I20260805 23:05:36.726796 16393 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:36.727866 16393 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:36.729089 16393 hybrid_clock.cc:648] HybridClock initialized: now 1785971136729037 us; error 48 us; skew 500 ppm
I20260805 23:05:36.729427 16393 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:36.732123 16393 webserver.cc:460] Webserver started at http://127.22.45.66:44133/ using document root <none> and password file <none>
I20260805 23:05:36.732950 16393 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:36.733083 16393 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:36.733420 16393 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:36.736784 16393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "7f5d45b17cbb438d8bf82f4c21172cbf"
format_stamp: "Formatted at 2026-08-05 23:05:36 on dist-test-slave-1vmg"
server_key: "34e3e27abe7ae64f6e15cd3c098c066b"
server_key_iv: "47ddfec4affc4b3e886549bcd8304901"
server_key_version: "encryptionkey@0"
I20260805 23:05:36.737704 16393 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "7f5d45b17cbb438d8bf82f4c21172cbf"
format_stamp: "Formatted at 2026-08-05 23:05:36 on dist-test-slave-1vmg"
server_key: "34e3e27abe7ae64f6e15cd3c098c066b"
server_key_iv: "47ddfec4affc4b3e886549bcd8304901"
server_key_version: "encryptionkey@0"
I20260805 23:05:36.744318 16393 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 23:05:36.748636 16412 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:36.750234 16393 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260805 23:05:36.750464 16393 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "7f5d45b17cbb438d8bf82f4c21172cbf"
format_stamp: "Formatted at 2026-08-05 23:05:36 on dist-test-slave-1vmg"
server_key: "34e3e27abe7ae64f6e15cd3c098c066b"
server_key_iv: "47ddfec4affc4b3e886549bcd8304901"
server_key_version: "encryptionkey@0"
I20260805 23:05:36.750725 16393 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:36.785735 16393 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:36.786744 16393 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:36.787096 16393 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:36.788275 16393 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:36.789953 16393 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:36.790074 16393 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:36.790195 16393 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:36.790283 16393 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:36.824093 16393 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:42911
I20260805 23:05:36.824173 16561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:42911 every 8 connection(s)
I20260805 23:05:36.825516 16393 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:05:36.829337 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 16393
I20260805 23:05:36.829548 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:05:36.830133 22709 external_mini_cluster.cc:1428] Setting key 1ec9c8509450cc65443fe71623a62c41
I20260805 23:05:36.833211 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42941
--builtin_ntp_servers=127.22.45.84:38367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 23:05:36.839805 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:36.828386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:57745 (local address 127.22.45.126:42941)
0805 23:05:36.828885 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:36.828890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:36.830460 (+ 1570us) server_negotiation.cc:407] Connection header received
0805 23:05:36.832455 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:36.832460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:36.832560 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:36.832659 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:36.834002 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.834783 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.836573 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.837017 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.837140 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:36.838839 (+ 1699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:36.838847 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:36.838852 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:36.838878 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:36.838965 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:36.838985 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:36.839068 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:36.839353 (+ 285us) server_negotiation.cc:299] Negotiation successful
0805 23:05:36.839454 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":237,"threads_started":1}
I20260805 23:05:36.841439 16565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:36.829137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:42941 (local address 127.22.45.66:57745)
0805 23:05:36.830269 (+ 1132us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:36.830326 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:36.832136 (+ 1810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:36.832954 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:36.832963 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:36.833069 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:36.833808 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:36.833828 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.834987 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.834992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:36.836389 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:36.836412 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:36.837290 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:36.837300 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:36.837544 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:36.838393 (+ 849us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:36.838397 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:36.838463 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:36.838585 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:36.839094 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:36.839106 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:36.839115 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 23:05:36.839334 (+ 219us) client_negotiation.cc:240] Negotiation successful
0805 23:05:36.839848 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":379,"threads_started":1}
I20260805 23:05:36.843350 16562 heartbeater.cc:347] Connected to a master server at 127.22.45.126:42941
I20260805 23:05:36.843724 16562 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:36.844575 16562 heartbeater.cc:511] Master 127.22.45.126:42941 requested a full tablet report, sending...
I20260805 23:05:36.846293 16141 ts_manager.cc:194] Registered new tserver with Master: 7f5d45b17cbb438d8bf82f4c21172cbf (127.22.45.66:42911)
I20260805 23:05:36.847225 16141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.66:57745
W20260805 23:05:37.191270 16567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:37.191636 16567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:37.191771 16567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:37.199458 16567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:37.199615 16567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:37.199781 16567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:05:37.209813 16567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:42941
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:37.211388 16567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:37.213387 16567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:37.227491 16575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:37.227443 16578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:37.227522 16572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:37.228444 16567 server_base.cc:1034] running on GCE node
I20260805 23:05:37.229138 16567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:37.230219 16567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:37.231437 16567 hybrid_clock.cc:648] HybridClock initialized: now 1785971137231379 us; error 56 us; skew 500 ppm
I20260805 23:05:37.231796 16567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:37.234457 16567 webserver.cc:460] Webserver started at http://127.22.45.67:45331/ using document root <none> and password file <none>
I20260805 23:05:37.235344 16567 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:37.235463 16567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:37.235812 16567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:37.239133 16567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "7b8cf071564f4b2bb659447d621bfb74"
format_stamp: "Formatted at 2026-08-05 23:05:37 on dist-test-slave-1vmg"
server_key: "a005ecd6937a07597f7a7af2a6ba036a"
server_key_iv: "1d75e56b7a74bc2dac14d87def1303d4"
server_key_version: "encryptionkey@0"
I20260805 23:05:37.240109 16567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "7b8cf071564f4b2bb659447d621bfb74"
format_stamp: "Formatted at 2026-08-05 23:05:37 on dist-test-slave-1vmg"
server_key: "a005ecd6937a07597f7a7af2a6ba036a"
server_key_iv: "1d75e56b7a74bc2dac14d87def1303d4"
server_key_version: "encryptionkey@0"
I20260805 23:05:37.246274 16567 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 23:05:37.250494 16584 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:37.252143 16567 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:37.252354 16567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "7b8cf071564f4b2bb659447d621bfb74"
format_stamp: "Formatted at 2026-08-05 23:05:37 on dist-test-slave-1vmg"
server_key: "a005ecd6937a07597f7a7af2a6ba036a"
server_key_iv: "1d75e56b7a74bc2dac14d87def1303d4"
server_key_version: "encryptionkey@0"
I20260805 23:05:37.252597 16567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:37.274030 16567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:37.275072 16567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:37.275425 16567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:37.276597 16567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:37.278316 16567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:37.278430 16567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:37.278548 16567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:37.278625 16567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:37.309978 16567 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:38093
I20260805 23:05:37.310041 16744 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:38093 every 8 connection(s)
I20260805 23:05:37.311414 16567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:05:37.318701 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 16567
I20260805 23:05:37.318945 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:05:37.319527 22709 external_mini_cluster.cc:1428] Setting key 8a2fc6fcb9502d73555050d88c902940
I20260805 23:05:37.324715 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.314154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:54839 (local address 127.22.45.126:42941)
0805 23:05:37.314317 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.314322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.316001 (+ 1679us) server_negotiation.cc:407] Connection header received
0805 23:05:37.317843 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.317849 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.317942 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.318034 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:37.319467 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.320283 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.322190 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.322652 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.322757 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.324081 (+ 1324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:37.324085 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:37.324089 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:37.324107 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:37.324139 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:37.324151 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:37.324223 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.324394 (+ 171us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.324474 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260805 23:05:37.325953 16749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.314831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:42941 (local address 127.22.45.67:54839)
0805 23:05:37.315832 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.315870 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:37.317535 (+ 1665us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:37.318288 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:37.318300 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:37.318416 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:37.319272 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.319300 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.320446 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.320452 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.322039 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.322056 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.322859 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.322864 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.323124 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.323775 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:37.323778 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:37.323817 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:37.323906 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:37.324226 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:37.324233 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:37.324238 (+ 5us) client_negotiation.cc:769] Sending connection context
0805 23:05:37.324369 (+ 131us) client_negotiation.cc:240] Negotiation successful
0805 23:05:37.324673 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":332,"threads_started":1}
I20260805 23:05:37.327505 16746 heartbeater.cc:347] Connected to a master server at 127.22.45.126:42941
I20260805 23:05:37.327868 16746 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:37.328856 16746 heartbeater.cc:511] Master 127.22.45.126:42941 requested a full tablet report, sending...
I20260805 23:05:37.330468 16141 ts_manager.cc:194] Registered new tserver with Master: 7b8cf071564f4b2bb659447d621bfb74 (127.22.45.67:38093)
I20260805 23:05:37.331633 16141 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.67:54839
I20260805 23:05:37.334573 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:05:37.339712 16389 heartbeater.cc:503] Master 127.22.45.126:42941 was elected leader, sending a full tablet report...
I20260805 23:05:37.344565 16564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.338605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32836 (local address 127.22.45.126:42941)
0805 23:05:37.338788 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.338793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.339296 (+ 503us) server_negotiation.cc:407] Connection header received
0805 23:05:37.339469 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.339474 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.339549 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.339646 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:37.340190 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.340978 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.342382 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.342804 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.342896 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.343955 (+ 1059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:37.343960 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:37.343963 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:37.343981 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:37.344014 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:37.344026 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:37.344133 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.344259 (+ 126us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.344304 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 23:05:37.348292 16141 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32836:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:05:37.355377 16141 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:05:37.384956 16759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.369182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60262)
0805 23:05:37.370111 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.370156 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:37.370396 (+ 240us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:37.377085 (+ 6689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:37.377095 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:37.377132 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:37.377762 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.377777 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.379702 (+ 1925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.379708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.381923 (+ 2215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.381936 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.383915 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.383923 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.384134 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.384188 (+ 54us) client_negotiation.cc:769] Sending connection context
0805 23:05:37.384311 (+ 123us) client_negotiation.cc:240] Negotiation successful
0805 23:05:37.384534 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":129,"thread_start_us":381,"threads_started":1}
I20260805 23:05:37.385560 16766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.369813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:38093 (local address 127.0.0.1:57152)
0805 23:05:37.371097 (+ 1284us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.371116 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:37.371250 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:37.378591 (+ 7341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:37.378596 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:37.378625 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:37.379049 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.379062 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.381013 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.381019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.382885 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.382897 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.384807 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.384814 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.385001 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.385038 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 23:05:37.385128 (+ 90us) client_negotiation.cc:240] Negotiation successful
0805 23:05:37.385261 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1146,"thread_start_us":5875,"threads_started":1}
I20260805 23:05:37.385658 16767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.371084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42376 (local address 127.22.45.66:42911)
0805 23:05:37.375591 (+ 4507us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.375602 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.376347 (+ 745us) server_negotiation.cc:407] Connection header received
0805 23:05:37.376460 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.376468 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.376730 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.376948 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:37.378022 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.379406 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.382422 (+ 3016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.383846 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.383977 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.384276 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.385122 (+ 846us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.385324 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4271,"thread_start_us":4101,"threads_started":1}
I20260805 23:05:37.385166 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.370499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:42911 (local address 127.0.0.1:42376)
0805 23:05:37.375990 (+ 5491us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.376012 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:37.376184 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:37.377239 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:37.377244 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:37.377277 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:37.377760 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.377774 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.379578 (+ 1804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.379583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.382201 (+ 2618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.382224 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.384408 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.384414 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.384567 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.384598 (+ 31us) client_negotiation.cc:769] Sending connection context
0805 23:05:37.384690 (+ 92us) client_negotiation.cc:240] Negotiation successful
0805 23:05:37.384817 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5357,"mutex_wait_us":205,"thread_start_us":775,"threads_started":1}
I20260805 23:05:37.386197 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.369326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60262 (local address 127.22.45.65:45327)
0805 23:05:37.376147 (+ 6821us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.376157 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.376199 (+ 42us) server_negotiation.cc:407] Connection header received
0805 23:05:37.376361 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.376371 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.376713 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.377873 (+ 1160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:37.378120 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.379523 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.382124 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.383655 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.385324 (+ 1669us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.385592 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.385667 (+ 75us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.385852 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6601,"thread_start_us":7852,"threads_started":1}
I20260805 23:05:37.386428 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.370067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57152 (local address 127.22.45.67:38093)
0805 23:05:37.377920 (+ 7853us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.377937 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.377973 (+ 36us) server_negotiation.cc:407] Connection header received
0805 23:05:37.378066 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.378073 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.378347 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.378563 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:37.379272 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.380852 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.383085 (+ 2233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.384596 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.384720 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.384998 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.385935 (+ 937us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.386112 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7675,"thread_start_us":7512,"threads_started":1}
I20260805 23:05:37.390296 16647 tablet_service.cc:1467] Processing CreateTablet for tablet e1b6459562734d1e9d232dc4619a1a94 (DEFAULT_TABLE table=test-table [id=0d8d71d8b42142f0ad057e09e9500d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:37.390255 16475 tablet_service.cc:1467] Processing CreateTablet for tablet e1b6459562734d1e9d232dc4619a1a94 (DEFAULT_TABLE table=test-table [id=0d8d71d8b42142f0ad057e09e9500d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:37.390254 16302 tablet_service.cc:1467] Processing CreateTablet for tablet e1b6459562734d1e9d232dc4619a1a94 (DEFAULT_TABLE table=test-table [id=0d8d71d8b42142f0ad057e09e9500d9e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:37.391790 16647 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1b6459562734d1e9d232dc4619a1a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:37.391834 16302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1b6459562734d1e9d232dc4619a1a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:37.391834 16475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1b6459562734d1e9d232dc4619a1a94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:37.405019 16768 tablet_bootstrap.cc:492] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Bootstrap starting.
I20260805 23:05:37.408599 16768 tablet_bootstrap.cc:654] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:37.409608 16770 tablet_bootstrap.cc:492] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Bootstrap starting.
I20260805 23:05:37.410566 16769 tablet_bootstrap.cc:492] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e: Bootstrap starting.
I20260805 23:05:37.411948 16768 log.cc:824] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:37.414079 16770 tablet_bootstrap.cc:654] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:37.414283 16769 tablet_bootstrap.cc:654] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:37.415200 16770 log.cc:824] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:37.415567 16769 log.cc:824] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:37.415702 16768 tablet_bootstrap.cc:492] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: No bootstrap required, opened a new log
I20260805 23:05:37.416066 16768 ts_tablet_manager.cc:1397] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260805 23:05:37.418205 16769 tablet_bootstrap.cc:492] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e: No bootstrap required, opened a new log
I20260805 23:05:37.418391 16770 tablet_bootstrap.cc:492] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: No bootstrap required, opened a new log
I20260805 23:05:37.418517 16769 ts_tablet_manager.cc:1397] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260805 23:05:37.418704 16770 ts_tablet_manager.cc:1397] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.007s
I20260805 23:05:37.426476 16769 raft_consensus.cc:348] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.426970 16769 raft_consensus.cc:374] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:37.427096 16769 raft_consensus.cc:729] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69616d61e369471794ea59f4a506c54e, State: Initialized, Role: FOLLOWER
I20260805 23:05:37.427785 16769 consensus_queue.cc:260] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.427789 16768 raft_consensus.cc:348] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.428287 16768 raft_consensus.cc:374] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:37.428471 16768 raft_consensus.cc:729] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8cf071564f4b2bb659447d621bfb74, State: Initialized, Role: FOLLOWER
I20260805 23:05:37.429327 16770 raft_consensus.cc:348] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.429819 16769 ts_tablet_manager.cc:1428] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e: Time spent starting tablet: real 0.011s user 0.005s sys 0.004s
I20260805 23:05:37.429876 16770 raft_consensus.cc:374] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:37.429814 16768 consensus_queue.cc:260] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.430035 16770 raft_consensus.cc:729] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f5d45b17cbb438d8bf82f4c21172cbf, State: Initialized, Role: FOLLOWER
I20260805 23:05:37.430833 16770 consensus_queue.cc:260] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.431843 16746 heartbeater.cc:503] Master 127.22.45.126:42941 was elected leader, sending a full tablet report...
I20260805 23:05:37.433657 16768 ts_tablet_manager.cc:1428] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
I20260805 23:05:37.433799 16562 heartbeater.cc:503] Master 127.22.45.126:42941 was elected leader, sending a full tablet report...
I20260805 23:05:37.435225 16778 raft_consensus.cc:482] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:05:37.435631 16778 raft_consensus.cc:504] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.441128 16770 ts_tablet_manager.cc:1428] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Time spent starting tablet: real 0.022s user 0.014s sys 0.000s
I20260805 23:05:37.442539 16778 leader_election.cc:288] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69616d61e369471794ea59f4a506c54e (127.22.45.65:45327), 7b8cf071564f4b2bb659447d621bfb74 (127.22.45.67:38093)
I20260805 23:05:37.449723 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.438783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:49271 (local address 127.22.45.65:45327)
0805 23:05:37.439082 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.439088 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.443174 (+ 4086us) server_negotiation.cc:407] Connection header received
0805 23:05:37.443560 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.443567 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.443677 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.443788 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:37.444805 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.445734 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.447848 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.448669 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.448857 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.448932 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.449306 (+ 374us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.449448 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 23:05:37.449709 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.438583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:41659 (local address 127.22.45.67:38093)
0805 23:05:37.438794 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.438801 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.443431 (+ 4630us) server_negotiation.cc:407] Connection header received
0805 23:05:37.443679 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.443683 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.443748 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.443836 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:37.444858 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.445762 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.447852 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.448696 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.448872 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.448950 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.449320 (+ 370us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.449454 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 23:05:37.449826 16781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.438223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:38093 (local address 127.22.45.66:41659)
0805 23:05:37.443324 (+ 5101us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.443340 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:37.443533 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:37.443990 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:37.443995 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:37.444022 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:37.444509 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.444522 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.445914 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.445920 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.447642 (+ 1722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.447658 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.448933 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.448940 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.449143 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.449183 (+ 40us) client_negotiation.cc:769] Sending connection context
0805 23:05:37.449270 (+ 87us) client_negotiation.cc:240] Negotiation successful
0805 23:05:37.449452 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4982,"mutex_wait_us":735,"thread_start_us":3852,"threads_started":1}
I20260805 23:05:37.449843 16782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.438223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.22.45.66:49271)
0805 23:05:37.443019 (+ 4796us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.443046 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:37.443321 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:37.444118 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:37.444129 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:37.444172 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:37.444607 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.444618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.445886 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.445892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.447608 (+ 1716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:37.447629 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.448914 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.448922 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:37.449128 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.449165 (+ 37us) client_negotiation.cc:769] Sending connection context
0805 23:05:37.449258 (+ 93us) client_negotiation.cc:240] Negotiation successful
0805 23:05:37.449455 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4589,"mutex_wait_us":47,"thread_start_us":4755,"threads_started":1}
I20260805 23:05:37.450950 16329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b6459562734d1e9d232dc4619a1a94" candidate_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69616d61e369471794ea59f4a506c54e" is_pre_election: true
I20260805 23:05:37.450994 16677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b6459562734d1e9d232dc4619a1a94" candidate_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8cf071564f4b2bb659447d621bfb74" is_pre_election: true
I20260805 23:05:37.451519 16677 raft_consensus.cc:2454] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f5d45b17cbb438d8bf82f4c21172cbf in term 0.
I20260805 23:05:37.451519 16329 raft_consensus.cc:2454] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f5d45b17cbb438d8bf82f4c21172cbf in term 0.
I20260805 23:05:37.452204 16416 leader_election.cc:302] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8cf071564f4b2bb659447d621bfb74, 7f5d45b17cbb438d8bf82f4c21172cbf; no voters:
I20260805 23:05:37.452636 16778 raft_consensus.cc:2781] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:05:37.452816 16778 raft_consensus.cc:482] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:05:37.452925 16778 raft_consensus.cc:3037] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:37.455513 16778 raft_consensus.cc:504] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.456350 16778 leader_election.cc:288] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [CANDIDATE]: Term 1 election: Requested vote from peers 69616d61e369471794ea59f4a506c54e (127.22.45.65:45327), 7b8cf071564f4b2bb659447d621bfb74 (127.22.45.67:38093)
I20260805 23:05:37.456923 16677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b6459562734d1e9d232dc4619a1a94" candidate_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8cf071564f4b2bb659447d621bfb74"
I20260805 23:05:37.456967 16329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1b6459562734d1e9d232dc4619a1a94" candidate_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69616d61e369471794ea59f4a506c54e"
I20260805 23:05:37.457172 16677 raft_consensus.cc:3037] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:37.457203 16329 raft_consensus.cc:3037] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:37.459770 16677 raft_consensus.cc:2454] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f5d45b17cbb438d8bf82f4c21172cbf in term 1.
I20260805 23:05:37.459774 16329 raft_consensus.cc:2454] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f5d45b17cbb438d8bf82f4c21172cbf in term 1.
I20260805 23:05:37.460387 16415 leader_election.cc:302] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 69616d61e369471794ea59f4a506c54e, 7f5d45b17cbb438d8bf82f4c21172cbf; no voters:
I20260805 23:05:37.460788 16778 raft_consensus.cc:2781] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:37.460964 16778 raft_consensus.cc:686] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 1 LEADER]: Becoming Leader. State: Replica: 7f5d45b17cbb438d8bf82f4c21172cbf, State: Running, Role: LEADER
I20260805 23:05:37.461522 16778 consensus_queue.cc:237] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } }
I20260805 23:05:37.466487 16141 catalog_manager.cc:5495] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f5d45b17cbb438d8bf82f4c21172cbf (127.22.45.66). New cstate: current_term: 1 leader_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f5d45b17cbb438d8bf82f4c21172cbf" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 42911 } health_report { overall_health: HEALTHY } } }
I20260805 23:05:37.494172 16767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.488931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42390 (local address 127.22.45.66:42911)
0805 23:05:37.489123 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.489127 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.489147 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:05:37.489291 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.489295 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.489389 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.489526 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:05:37.489852 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.490575 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.492024 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.492460 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.492562 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.493077 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:05:37.493621 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:05:37.493775 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.493830 (+ 55us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.493874 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 23:05:37.503454 16329 raft_consensus.cc:1261] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 1 FOLLOWER]: Refusing update from remote peer 7f5d45b17cbb438d8bf82f4c21172cbf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:37.503455 16677 raft_consensus.cc:1261] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 1 FOLLOWER]: Refusing update from remote peer 7f5d45b17cbb438d8bf82f4c21172cbf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:37.504518 16780 consensus_queue.cc:1035] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "69616d61e369471794ea59f4a506c54e" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 45327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:37.504899 16778 consensus_queue.cc:1035] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8cf071564f4b2bb659447d621bfb74" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 38093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:37.518496 16785 mvcc.cc:205] Tried to move back new op lower bound from 7315337779203174400 to 7315337779046809600. Current Snapshot: MvccSnapshot[applied={T|T < 7315337779203174400}]
I20260805 23:05:37.534469 16140 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:37.534816 16140 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32836:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:37.539651 16140 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5b1151acdf33432f9b17caa36679c2a0: Sending DeleteTablet for 3 replicas of tablet e1b6459562734d1e9d232dc4619a1a94
I20260805 23:05:37.541097 16647 tablet_service.cc:1514] Processing DeleteTablet for tablet e1b6459562734d1e9d232dc4619a1a94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:37 UTC) from {username='slave'} at 127.0.0.1:57152
I20260805 23:05:37.541249 16475 tablet_service.cc:1514] Processing DeleteTablet for tablet e1b6459562734d1e9d232dc4619a1a94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:37 UTC) from {username='slave'} at 127.0.0.1:42376
I20260805 23:05:37.541180 16302 tablet_service.cc:1514] Processing DeleteTablet for tablet e1b6459562734d1e9d232dc4619a1a94 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:37 UTC) from {username='slave'} at 127.0.0.1:60262
I20260805 23:05:37.543490 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 16220
I20260805 23:05:37.553622 16797 tablet_replica.cc:330] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: stopping tablet replica
I20260805 23:05:37.554248 16797 raft_consensus.cc:2229] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:37.554886 16797 raft_consensus.cc:2258] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:37.557559 16798 tablet_replica.cc:330] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e: stopping tablet replica
I20260805 23:05:37.558861 16797 ts_tablet_manager.cc:1905] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:37.560694 16795 tablet_replica.cc:330] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: stopping tablet replica
I20260805 23:05:37.561280 16795 raft_consensus.cc:2229] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:05:37.562059 16760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.544965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60268 (local address 127.22.45.65:45327)
0805 23:05:37.545185 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.545193 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.549708 (+ 4515us) server_negotiation.cc:407] Connection header received
0805 23:05:37.550745 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.550753 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.550901 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.551026 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:37.552272 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.553474 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.557348 (+ 3874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.558094 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.558236 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.560034 (+ 1798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:37.560048 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:37.560068 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:37.560956 (+ 888us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:37.561028 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:37.561061 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:37.561181 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.561521 (+ 340us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.561672 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 23:05:37.563217 16795 raft_consensus.cc:2258] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:37.563437 16383 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:37.566020 16795 ts_tablet_manager.cc:1905] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:37.566669 16797 ts_tablet_manager.cc:1918] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:37.566870 16797 log.cc:1196] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/e1b6459562734d1e9d232dc4619a1a94
I20260805 23:05:37.568492 16797 ts_tablet_manager.cc:1939] T e1b6459562734d1e9d232dc4619a1a94 P 7b8cf071564f4b2bb659447d621bfb74: Deleting consensus metadata
I20260805 23:05:37.570756 16121 catalog_manager.cc:4841] TS 7b8cf071564f4b2bb659447d621bfb74 (127.22.45.67:38093): tablet e1b6459562734d1e9d232dc4619a1a94 (table test-table [id=0d8d71d8b42142f0ad057e09e9500d9e]) successfully deleted
I20260805 23:05:37.573431 16795 ts_tablet_manager.cc:1918] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:37.573639 16795 log.cc:1196] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/e1b6459562734d1e9d232dc4619a1a94
I20260805 23:05:37.574342 16795 ts_tablet_manager.cc:1939] T e1b6459562734d1e9d232dc4619a1a94 P 7f5d45b17cbb438d8bf82f4c21172cbf: Deleting consensus metadata
I20260805 23:05:37.576711 16119 catalog_manager.cc:4841] TS 7f5d45b17cbb438d8bf82f4c21172cbf (127.22.45.66:42911): tablet e1b6459562734d1e9d232dc4619a1a94 (table test-table [id=0d8d71d8b42142f0ad057e09e9500d9e]) successfully deleted
I20260805 23:05:37.567817 16798 raft_consensus.cc:2229] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:37.699343 16798 raft_consensus.cc:2258] T e1b6459562734d1e9d232dc4619a1a94 P 69616d61e369471794ea59f4a506c54e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:37.699532 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 16220
W20260805 23:05:37.732707 16119 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.45.65:45327 (error 108)
I20260805 23:05:37.732997 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 16393
I20260805 23:05:37.734881 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.734409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60272)
0805 23:05:37.734580 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.734702 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260805 23:05:37.735213 16119 catalog_manager.cc:4584] TS 69616d61e369471794ea59f4a506c54e (127.22.45.65:45327): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e1b6459562734d1e9d232dc4619a1a94: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
I20260805 23:05:37.742597 16767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.734629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42398 (local address 127.22.45.66:42911)
0805 23:05:37.734846 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.734852 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.734876 (+ 24us) server_negotiation.cc:407] Connection header received
0805 23:05:37.734985 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.734994 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.735104 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.735203 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:37.735876 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.737050 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.738402 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.739298 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.739456 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.740658 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:37.740672 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:37.740693 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:37.741613 (+ 920us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:37.741694 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:37.741723 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:37.741857 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.742048 (+ 191us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.742181 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 23:05:37.743662 16557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:37.789312 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.788616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60284)
0805 23:05:37.788927 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.789058 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260805 23:05:37.791074 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.790503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60298)
0805 23:05:37.790707 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.790835 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260805 23:05:37.852167 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.851507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60312)
0805 23:05:37.851793 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.851920 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260805 23:05:37.853792 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.853318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60324)
0805 23:05:37.853513 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.853630 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260805 23:05:37.863641 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 16393
I20260805 23:05:37.889814 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 16567
I20260805 23:05:37.897186 16764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.890642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57156 (local address 127.22.45.67:38093)
0805 23:05:37.890838 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:37.890845 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:37.890967 (+ 122us) server_negotiation.cc:407] Connection header received
0805 23:05:37.891154 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:37.891159 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:37.891255 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:37.891348 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:37.891797 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.892577 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.893949 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:37.894381 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:37.894506 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:37.895723 (+ 1217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:37.895733 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:37.895750 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:37.896397 (+ 647us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:37.896451 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:37.896472 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:37.896586 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:37.896729 (+ 143us) server_negotiation.cc:299] Negotiation successful
0805 23:05:37.896860 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:05:37.897924 16739 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:37.935180 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.934522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60334)
0805 23:05:37.934807 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.934969 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112}
I20260805 23:05:37.936359 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:37.935896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60350)
0805 23:05:37.936109 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:37.936201 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260805 23:05:37.988401 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 16567
I20260805 23:05:38.010047 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 16098
I20260805 23:05:38.011212 16181 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:38.121480 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:38.120813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:45327 (local address 127.0.0.1:60358)
0805 23:05:38.121136 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:38.121265 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:45327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
I20260805 23:05:38.121551 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 16098
2026-08-05T23:05:38Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3013 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:38 dist-test-slave-1vmg krb5kdc[16811](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:38 dist-test-slave-1vmg krb5kdc[16811](info): set up 2 sockets
Aug 05 23:05:38 dist-test-slave-1vmg krb5kdc[16811](info): commencing operation
krb5kdc: starting...
W20260805 23:05:39.369936 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.200s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:39 dist-test-slave-1vmg krb5kdc[16811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:05:39.688383 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34705
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:34705
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:40.064363 16831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:40.064714 16831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:40.064867 16831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:40.072825 16831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:40.072992 16831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:40.073084 16831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:40.073180 16831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:40.073249 16831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:40.084096 16831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:34705
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:34705
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:40.085657 16831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:40.087276 16831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:40.100620 16838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:40.100698 16839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:40.100662 16841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:40.101629 16831 server_base.cc:1034] running on GCE node
I20260805 23:05:40.102507 16831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:40.104143 16831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:40.105369 16831 hybrid_clock.cc:648] HybridClock initialized: now 1785971140105311 us; error 56 us; skew 500 ppm
I20260805 23:05:40.105729 16831 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:40 dist-test-slave-1vmg krb5kdc[16811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971140, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:40.114439 16831 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:05:40.116258 16831 webserver.cc:460] Webserver started at http://127.22.45.126:37409/ using document root <none> and password file <none>
I20260805 23:05:40.117074 16831 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:40.117197 16831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:40.117484 16831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:40.120955 16831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "3d29feb6dbeb46f09ef3b80cace95866"
format_stamp: "Formatted at 2026-08-05 23:05:40 on dist-test-slave-1vmg"
server_key: "82d9cbc93599d0ce844fae4d7ffd5aca"
server_key_iv: "7c4abdbdebfd242ed0159fcf62694bf9"
server_key_version: "encryptionkey@0"
I20260805 23:05:40.121776 16831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "3d29feb6dbeb46f09ef3b80cace95866"
format_stamp: "Formatted at 2026-08-05 23:05:40 on dist-test-slave-1vmg"
server_key: "82d9cbc93599d0ce844fae4d7ffd5aca"
server_key_iv: "7c4abdbdebfd242ed0159fcf62694bf9"
server_key_version: "encryptionkey@0"
I20260805 23:05:40.128147 16831 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260805 23:05:40.132303 16849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:40.134002 16831 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:05:40.134181 16831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "3d29feb6dbeb46f09ef3b80cace95866"
format_stamp: "Formatted at 2026-08-05 23:05:40 on dist-test-slave-1vmg"
server_key: "82d9cbc93599d0ce844fae4d7ffd5aca"
server_key_iv: "7c4abdbdebfd242ed0159fcf62694bf9"
server_key_version: "encryptionkey@0"
I20260805 23:05:40.134382 16831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:40.163427 16831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:40.168267 16831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:40.168584 16831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:40.187778 16831 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:34705
I20260805 23:05:40.187779 16922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:34705 every 8 connection(s)
I20260805 23:05:40.189410 16831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:40.191216 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 16831
I20260805 23:05:40.191398 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:40.191991 22709 external_mini_cluster.cc:1428] Setting key a8f3e1e31fb3fae4ae65846755d770e0
I20260805 23:05:40.194307 16924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:40.207928 16924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866: Bootstrap starting.
Aug 05 23:05:40 dist-test-slave-1vmg krb5kdc[16811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:40.212277 16924 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:40.213822 16924 log.cc:824] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:40.218030 16924 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866: No bootstrap required, opened a new log
I20260805 23:05:40.219509 16930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:40.194067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60630 (local address 127.22.45.126:34705)
0805 23:05:40.194987 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:40.195002 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:40.195062 (+ 60us) server_negotiation.cc:407] Connection header received
0805 23:05:40.197315 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:40.197343 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:40.197875 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:40.198333 (+ 458us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:40.199988 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:40.202047 (+ 2059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:40.203536 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:40.204604 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:40.204810 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:40.209444 (+ 4634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:40.209459 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:40.209487 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:40.209564 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:40.213977 (+ 4413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:40.215184 (+ 1207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:40.215194 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:40.215201 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:40.215437 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:40.215897 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:40.215903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:40.215906 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:40.216686 (+ 780us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:40.217041 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:40.217450 (+ 409us) server_negotiation.cc:299] Negotiation successful
0805 23:05:40.217951 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":661,"thread_start_us":411,"threads_started":1}
I20260805 23:05:40.227470 16924 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29feb6dbeb46f09ef3b80cace95866" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34705 } }
I20260805 23:05:40.228034 16924 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:40.228139 16924 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d29feb6dbeb46f09ef3b80cace95866, State: Initialized, Role: FOLLOWER
I20260805 23:05:40.228729 16924 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29feb6dbeb46f09ef3b80cace95866" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34705 } }
I20260805 23:05:40.228981 16924 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:40.229090 16924 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:40.229228 16924 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:40.231631 16924 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29feb6dbeb46f09ef3b80cace95866" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34705 } }
I20260805 23:05:40.232221 16924 leader_election.cc:302] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d29feb6dbeb46f09ef3b80cace95866; no voters:
I20260805 23:05:40.232873 16924 leader_election.cc:288] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:40.233047 16932 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:40.233757 16932 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [term 1 LEADER]: Becoming Leader. State: Replica: 3d29feb6dbeb46f09ef3b80cace95866, State: Running, Role: LEADER
I20260805 23:05:40.234493 16932 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29feb6dbeb46f09ef3b80cace95866" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34705 } }
I20260805 23:05:40.235219 16924 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:40.238003 16933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d29feb6dbeb46f09ef3b80cace95866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29feb6dbeb46f09ef3b80cace95866" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34705 } } }
I20260805 23:05:40.238610 16933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:40.238437 16934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d29feb6dbeb46f09ef3b80cace95866. Latest consensus state: current_term: 1 leader_uuid: "3d29feb6dbeb46f09ef3b80cace95866" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d29feb6dbeb46f09ef3b80cace95866" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 34705 } } }
I20260805 23:05:40.238747 16934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:40.239636 16947 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:40.245443 16947 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:40.255788 16947 catalog_manager.cc:1347] Generated new cluster ID: 16f9bdb8cbda4880bc18b4875b0473e4
I20260805 23:05:40.255921 16947 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:40.276716 16947 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:40.278167 16947 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:40.289835 16947 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866: Generated new TSK 0
I20260805 23:05:40.290810 16947 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.45.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
Entry for principal kudu/127.22.45.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab.
I20260805 23:05:40.364550 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34705
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:40.733994 16960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:40.734380 16960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:40.734524 16960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:40.742990 16960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:40.743177 16960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:40.743361 16960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:05:40.754329 16960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.65.keytab
--principal=kudu/127.22.45.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:40.755910 16960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:40.757431 16960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:40.772473 16969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:40.772445 16968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:40.772539 16971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:40.773118 16960 server_base.cc:1034] running on GCE node
I20260805 23:05:40.773881 16960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:40.774984 16960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:40.776229 16960 hybrid_clock.cc:648] HybridClock initialized: now 1785971140776169 us; error 41 us; skew 500 ppm
I20260805 23:05:40.776602 16960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:40 dist-test-slave-1vmg krb5kdc[16811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971140, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:40.780319 16960 init.cc:377] Logged in from keytab as kudu/127.22.45.65@KRBTEST.COM (short username kudu)
I20260805 23:05:40.782050 16960 webserver.cc:460] Webserver started at http://127.22.45.65:35553/ using document root <none> and password file <none>
I20260805 23:05:40.782836 16960 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:40.783004 16960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:40.783350 16960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:40.786666 16960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "c765f9e102014ec1837ae598e45689ca"
format_stamp: "Formatted at 2026-08-05 23:05:40 on dist-test-slave-1vmg"
server_key: "5d9ee80b29cf58315f557a5506825cfc"
server_key_iv: "513fe3d05f841b86404ce02f0b312c19"
server_key_version: "encryptionkey@0"
I20260805 23:05:40.787592 16960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "c765f9e102014ec1837ae598e45689ca"
format_stamp: "Formatted at 2026-08-05 23:05:40 on dist-test-slave-1vmg"
server_key: "5d9ee80b29cf58315f557a5506825cfc"
server_key_iv: "513fe3d05f841b86404ce02f0b312c19"
server_key_version: "encryptionkey@0"
I20260805 23:05:40.793601 16960 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:05:40.797565 16980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:40.799167 16960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260805 23:05:40.799366 16960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "c765f9e102014ec1837ae598e45689ca"
format_stamp: "Formatted at 2026-08-05 23:05:40 on dist-test-slave-1vmg"
server_key: "5d9ee80b29cf58315f557a5506825cfc"
server_key_iv: "513fe3d05f841b86404ce02f0b312c19"
server_key_version: "encryptionkey@0"
I20260805 23:05:40.799587 16960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:40.816143 16960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:40.821290 16960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:40.821626 16960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:40.822770 16960 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:40.824360 16960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:40.824447 16960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:40.824560 16960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:40.824635 16960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:40.858536 16960 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:41087
I20260805 23:05:40.858573 17126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:41087 every 8 connection(s)
I20260805 23:05:40.860006 16960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:05:40.869567 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 16960
I20260805 23:05:40.869766 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:05:40.870229 22709 external_mini_cluster.cc:1428] Setting key 77b4c22103e5721b757f507f2ca876d6
Aug 05 23:05:40 dist-test-slave-1vmg krb5kdc[16811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971140, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.65@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:40.883780 17129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:40.862905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:51665 (local address 127.22.45.126:34705)
0805 23:05:40.863435 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:40.863439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:40.864598 (+ 1159us) server_negotiation.cc:407] Connection header received
0805 23:05:40.866631 (+ 2033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:40.866637 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:40.866750 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:40.866856 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:40.868736 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:40.869740 (+ 1004us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:40.871843 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:40.872383 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:40.872547 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:40.876645 (+ 4098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:40.876655 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:40.876660 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:40.876710 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:40.880011 (+ 3301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:40.880976 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:40.880984 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:40.880988 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:40.881168 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:40.881645 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:40.881651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:40.881654 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:40.882054 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:40.882219 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:40.883069 (+ 850us) server_negotiation.cc:299] Negotiation successful
0805 23:05:40.883345 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":247,"threads_started":1}
I20260805 23:05:40.884662 17130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:40.863586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34705 (local address 127.22.45.65:51665)
0805 23:05:40.864396 (+ 810us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:40.864444 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:40.866281 (+ 1837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:40.867187 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:40.867207 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:40.867817 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:40.868513 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:40.868534 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:40.869956 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:40.869960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:40.871642 (+ 1682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:40.871662 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:40.872654 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:40.872660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:40.872900 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:40.873633 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:40.873660 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:40.876275 (+ 2615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:40.880242 (+ 3967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:40.880252 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:40.880269 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:40.880793 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:40.881281 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:40.881286 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:40.881292 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:40.881510 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:40.882185 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:40.882193 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:40.882578 (+ 385us) client_negotiation.cc:769] Sending connection context
0805 23:05:40.882840 (+ 262us) client_negotiation.cc:240] Negotiation successful
0805 23:05:40.883352 (+ 512us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":308,"threads_started":1}
I20260805 23:05:40.886632 17127 heartbeater.cc:347] Connected to a master server at 127.22.45.126:34705
I20260805 23:05:40.887027 17127 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:40.887879 17127 heartbeater.cc:511] Master 127.22.45.126:34705 requested a full tablet report, sending...
I20260805 23:05:40.890550 16872 ts_manager.cc:194] Registered new tserver with Master: c765f9e102014ec1837ae598e45689ca (127.22.45.65:41087)
I20260805 23:05:40.892627 16872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.65@KRBTEST.COM'} at 127.22.45.65:51665
WARNING: no policy specified for kudu/127.22.45.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
Entry for principal kudu/127.22.45.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab.
I20260805 23:05:40.942167 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34705
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:41.302382 17133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:41.302721 17133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:41.302867 17133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:41.310549 17133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:41.310696 17133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:41.310844 17133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:05:41.321403 17133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.66.keytab
--principal=kudu/127.22.45.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:41.322876 17133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:41.324319 17133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:41.340214 17139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:41.340255 17143 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:41.340296 17141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:41.341091 17133 server_base.cc:1034] running on GCE node
I20260805 23:05:41.341758 17133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:41.342794 17133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:41.344066 17133 hybrid_clock.cc:648] HybridClock initialized: now 1785971141343989 us; error 67 us; skew 500 ppm
I20260805 23:05:41.344437 17133 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:41 dist-test-slave-1vmg krb5kdc[16811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971141, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:41.347944 17133 init.cc:377] Logged in from keytab as kudu/127.22.45.66@KRBTEST.COM (short username kudu)
I20260805 23:05:41.349550 17133 webserver.cc:460] Webserver started at http://127.22.45.66:36899/ using document root <none> and password file <none>
I20260805 23:05:41.350289 17133 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:41.350422 17133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:41.350756 17133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:41.353928 17133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "3a6e65319705493eab5662d4a9facf76"
format_stamp: "Formatted at 2026-08-05 23:05:41 on dist-test-slave-1vmg"
server_key: "ca25548fd650f681ad6019f37cac514d"
server_key_iv: "0f9a73a9a325b49858f75cdfad17c969"
server_key_version: "encryptionkey@0"
I20260805 23:05:41.354704 17133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "3a6e65319705493eab5662d4a9facf76"
format_stamp: "Formatted at 2026-08-05 23:05:41 on dist-test-slave-1vmg"
server_key: "ca25548fd650f681ad6019f37cac514d"
server_key_iv: "0f9a73a9a325b49858f75cdfad17c969"
server_key_version: "encryptionkey@0"
I20260805 23:05:41.359899 17133 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260805 23:05:41.363336 17150 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:41.364665 17133 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260805 23:05:41.364828 17133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "3a6e65319705493eab5662d4a9facf76"
format_stamp: "Formatted at 2026-08-05 23:05:41 on dist-test-slave-1vmg"
server_key: "ca25548fd650f681ad6019f37cac514d"
server_key_iv: "0f9a73a9a325b49858f75cdfad17c969"
server_key_version: "encryptionkey@0"
I20260805 23:05:41.365015 17133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:41.386238 17133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:41.390242 17133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:41.390517 17133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:41.391561 17133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:41.392968 17133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:41.393049 17133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:41.393175 17133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:41.393231 17133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:41.425495 17133 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:37785
I20260805 23:05:41.425563 17297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:37785 every 8 connection(s)
I20260805 23:05:41.426960 17133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:05:41.435490 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 17133
I20260805 23:05:41.435721 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:05:41.436187 22709 external_mini_cluster.cc:1428] Setting key e00f7ea5fc7adcab874a33d956867b67
Aug 05 23:05:41 dist-test-slave-1vmg krb5kdc[16811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971141, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.66@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:41.451386 17302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:41.429883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:55259 (local address 127.22.45.126:34705)
0805 23:05:41.430346 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:41.430350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:41.431534 (+ 1184us) server_negotiation.cc:407] Connection header received
0805 23:05:41.433493 (+ 1959us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:41.433498 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:41.433580 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:41.433710 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:41.435750 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:41.436678 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:41.438865 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:41.439537 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:41.439648 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:41.444219 (+ 4571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:41.444226 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:41.444230 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:41.444273 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:41.447340 (+ 3067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:41.448349 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:41.448354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:41.448356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:41.448537 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:41.449105 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:41.449109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:41.449111 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:41.449440 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:41.449619 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:41.450579 (+ 960us) server_negotiation.cc:299] Negotiation successful
0805 23:05:41.450898 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":349,"thread_start_us":234,"threads_started":1}
I20260805 23:05:41.452558 17303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:41.430511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34705 (local address 127.22.45.66:55259)
0805 23:05:41.431333 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:41.431383 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:41.433152 (+ 1769us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:41.433947 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:41.433956 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:41.434570 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:41.435468 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:41.435500 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:41.436885 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:41.436889 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:41.438686 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:41.438703 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:41.439823 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:41.439831 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:41.440133 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:41.440961 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:41.441002 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:41.443874 (+ 2872us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:41.447567 (+ 3693us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:41.447580 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:41.447597 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:41.448176 (+ 579us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:41.448681 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:41.448688 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:41.448692 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:41.448945 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:41.449609 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:41.449619 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:41.450089 (+ 470us) client_negotiation.cc:769] Sending connection context
0805 23:05:41.450406 (+ 317us) client_negotiation.cc:240] Negotiation successful
0805 23:05:41.451104 (+ 698us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":357,"threads_started":1}
I20260805 23:05:41.454341 17299 heartbeater.cc:347] Connected to a master server at 127.22.45.126:34705
I20260805 23:05:41.454744 17299 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:41.455798 17299 heartbeater.cc:511] Master 127.22.45.126:34705 requested a full tablet report, sending...
I20260805 23:05:41.457705 16872 ts_manager.cc:194] Registered new tserver with Master: 3a6e65319705493eab5662d4a9facf76 (127.22.45.66:37785)
I20260805 23:05:41.458806 16872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.66@KRBTEST.COM'} at 127.22.45.66:55259
WARNING: no policy specified for kudu/127.22.45.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
Entry for principal kudu/127.22.45.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab.
I20260805 23:05:41.508471 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34705
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:41.861173 17307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:41.861619 17307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:41.861778 17307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:41.870836 17307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:41.871029 17307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:41.871167 17307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:05:41.881605 17307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.67.keytab
--principal=kudu/127.22.45.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:34705
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:41.883042 17307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:41.884418 17307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260805 23:05:41.896879 17127 heartbeater.cc:503] Master 127.22.45.126:34705 was elected leader, sending a full tablet report...
W20260805 23:05:41.898479 17314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:41.899338 17316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:41.899379 17313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:41.900112 17307 server_base.cc:1034] running on GCE node
I20260805 23:05:41.900835 17307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:41.901968 17307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:41.903223 17307 hybrid_clock.cc:648] HybridClock initialized: now 1785971141903159 us; error 64 us; skew 500 ppm
I20260805 23:05:41.903620 17307 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:41 dist-test-slave-1vmg krb5kdc[16811](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971141, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:41.907294 17307 init.cc:377] Logged in from keytab as kudu/127.22.45.67@KRBTEST.COM (short username kudu)
I20260805 23:05:41.909165 17307 webserver.cc:460] Webserver started at http://127.22.45.67:34037/ using document root <none> and password file <none>
I20260805 23:05:41.909970 17307 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:41.910090 17307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:41.910403 17307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:41.913829 17307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "f20ba6564f204f68b92702037da6d94b"
format_stamp: "Formatted at 2026-08-05 23:05:41 on dist-test-slave-1vmg"
server_key: "0af9c6f0ce307349c2891e0cfa37d4b5"
server_key_iv: "6d4c651f633b13d37f53388b8fef01ea"
server_key_version: "encryptionkey@0"
I20260805 23:05:41.914709 17307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "f20ba6564f204f68b92702037da6d94b"
format_stamp: "Formatted at 2026-08-05 23:05:41 on dist-test-slave-1vmg"
server_key: "0af9c6f0ce307349c2891e0cfa37d4b5"
server_key_iv: "6d4c651f633b13d37f53388b8fef01ea"
server_key_version: "encryptionkey@0"
I20260805 23:05:41.920608 17307 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260805 23:05:41.924732 17324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:41.926203 17307 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 23:05:41.926370 17307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "f20ba6564f204f68b92702037da6d94b"
format_stamp: "Formatted at 2026-08-05 23:05:41 on dist-test-slave-1vmg"
server_key: "0af9c6f0ce307349c2891e0cfa37d4b5"
server_key_iv: "6d4c651f633b13d37f53388b8fef01ea"
server_key_version: "encryptionkey@0"
I20260805 23:05:41.926609 17307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:41.943645 17307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:41.948120 17307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:41.948444 17307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:41.949596 17307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:41.951232 17307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:41.951318 17307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:41.951434 17307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:41.951489 17307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:41.986891 17307 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:39293
I20260805 23:05:41.986954 17470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:39293 every 8 connection(s)
I20260805 23:05:41.988449 17307 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:05:41.990276 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 17307
I20260805 23:05:41.990448 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:05:41.991052 22709 external_mini_cluster.cc:1428] Setting key 20d3ecdae41a5963e8a33426d01dfe9f
Aug 05 23:05:42 dist-test-slave-1vmg krb5kdc[16811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971141, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.67@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:05:42.011726 17474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:41.991449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:59229 (local address 127.22.45.126:34705)
0805 23:05:41.991965 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:41.991972 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:41.993286 (+ 1314us) server_negotiation.cc:407] Connection header received
0805 23:05:41.995456 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:41.995462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:41.995560 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:41.995663 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:41.997530 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:41.998355 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.000186 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.000627 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.000754 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.004771 (+ 4017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:42.004778 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:42.004781 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:42.004821 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:42.008192 (+ 3371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.009244 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.009248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.009250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.009388 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.009837 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.009840 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.009842 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.010120 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:42.010255 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.011038 (+ 783us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.011312 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":249,"threads_started":1}
I20260805 23:05:42.012794 17475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:41.992211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:34705 (local address 127.22.45.67:59229)
0805 23:05:41.993095 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:41.993140 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:41.995112 (+ 1972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:41.995977 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:41.995987 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:41.996617 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:41.997308 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:41.997330 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:41.998546 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:41.998550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:41.999999 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.000016 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.000899 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.000907 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.001168 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.001912 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:05:42.001938 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:42.004479 (+ 2541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:42.008367 (+ 3888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:42.008379 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:42.008401 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:42.009116 (+ 715us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:42.009473 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:05:42.009476 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:05:42.009480 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:05:42.009746 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:05:42.010236 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:42.010243 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:42.010634 (+ 391us) client_negotiation.cc:769] Sending connection context
0805 23:05:42.010891 (+ 257us) client_negotiation.cc:240] Negotiation successful
0805 23:05:42.011525 (+ 634us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":334,"threads_started":1}
I20260805 23:05:42.014238 17471 heartbeater.cc:347] Connected to a master server at 127.22.45.126:34705
I20260805 23:05:42.014533 17471 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:42.015329 17471 heartbeater.cc:511] Master 127.22.45.126:34705 requested a full tablet report, sending...
I20260805 23:05:42.016872 16872 ts_manager.cc:194] Registered new tserver with Master: f20ba6564f204f68b92702037da6d94b (127.22.45.67:39293)
I20260805 23:05:42.017766 16872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.45.67@KRBTEST.COM'} at 127.22.45.67:59229
I20260805 23:05:42.019930 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:05:42.039389 17474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.025246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60634 (local address 127.22.45.126:34705)
0805 23:05:42.025468 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.025474 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.025851 (+ 377us) server_negotiation.cc:407] Connection header received
0805 23:05:42.026040 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.026044 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.026122 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.026220 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:42.027800 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.028555 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.029859 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.030284 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.030389 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.033107 (+ 2718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:42.033113 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:42.033117 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:42.033167 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:42.036019 (+ 2852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.037149 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.037156 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.037160 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.037356 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.037740 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.037744 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.037746 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.038161 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:42.038415 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.038740 (+ 325us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.039032 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260805 23:05:42.044049 16871 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60634:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:05:42.051712 16871 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:05:42.089485 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.066409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60512 (local address 127.22.45.65:41087)
0805 23:05:42.079447 (+ 13038us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.079458 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.079750 (+ 292us) server_negotiation.cc:407] Connection header received
0805 23:05:42.080168 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.080178 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.080495 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.080720 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:42.081786 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.083366 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.086290 (+ 2924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.087827 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.087939 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.088224 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.088928 (+ 704us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.089117 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12421,"thread_start_us":12557,"threads_started":1}
I20260805 23:05:42.090431 17487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.066204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:41087 (local address 127.0.0.1:60512)
0805 23:05:42.079542 (+ 13338us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:42.079607 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:42.079860 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:42.081052 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:42.081058 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:42.081091 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:42.081550 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.081563 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.083547 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.083553 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.086084 (+ 2531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.086102 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.088419 (+ 2317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.088426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.088642 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.088703 (+ 61us) client_negotiation.cc:769] Sending connection context
0805 23:05:42.089787 (+ 1084us) client_negotiation.cc:240] Negotiation successful
0805 23:05:42.090003 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12997,"mutex_wait_us":30,"thread_start_us":14850,"threads_started":1}
I20260805 23:05:42.092217 17491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.067155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36148 (local address 127.22.45.67:39293)
0805 23:05:42.081040 (+ 13885us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.081047 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.081249 (+ 202us) server_negotiation.cc:407] Connection header received
0805 23:05:42.081420 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.081429 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.081656 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.081841 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:42.084019 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.085634 (+ 1615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.088144 (+ 2510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.091002 (+ 2858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.091118 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.091367 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.091638 (+ 271us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.091814 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13702,"thread_start_us":13519,"threads_started":1}
I20260805 23:05:42.092875 17488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.066340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:39293 (local address 127.0.0.1:36148)
0805 23:05:42.081111 (+ 14771us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:42.081129 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:42.081275 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:42.082111 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:42.082115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:42.082139 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:42.083806 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.083819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.085805 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.085810 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.087957 (+ 2147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.087971 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.091222 (+ 3251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.091229 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.091419 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.091454 (+ 35us) client_negotiation.cc:769] Sending connection context
0805 23:05:42.091526 (+ 72us) client_negotiation.cc:240] Negotiation successful
0805 23:05:42.092573 (+ 1047us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14639,"mutex_wait_us":1,"thread_start_us":13787,"threads_started":1}
I20260805 23:05:42.097712 17388 tablet_service.cc:1467] Processing CreateTablet for tablet 34230edfd0674f44bc29420fd81e4f01 (DEFAULT_TABLE table=test-table [id=ede33417384d4cfcacf3303d8eb9df99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:42.101127 17388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34230edfd0674f44bc29420fd81e4f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:42.111088 17043 tablet_service.cc:1467] Processing CreateTablet for tablet 34230edfd0674f44bc29420fd81e4f01 (DEFAULT_TABLE table=test-table [id=ede33417384d4cfcacf3303d8eb9df99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:42.111750 17487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.081544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:37785 (local address 127.0.0.1:36052)
0805 23:05:42.090684 (+ 9140us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:42.090705 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:42.090814 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:42.104278 (+ 13464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:42.104284 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:42.104318 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:42.104534 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.104551 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.106776 (+ 2225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.106783 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.108724 (+ 1941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.108742 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.110940 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.110947 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.111154 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.111192 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 23:05:42.111291 (+ 99us) client_negotiation.cc:240] Negotiation successful
0805 23:05:42.111451 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9036,"thread_start_us":25355,"threads_started":1}
I20260805 23:05:42.112630 17493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.081758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36052 (local address 127.22.45.66:37785)
0805 23:05:42.103542 (+ 21784us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.103552 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.103590 (+ 38us) server_negotiation.cc:407] Connection header received
0805 23:05:42.103725 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.103733 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.104028 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.104265 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:42.105253 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.106608 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.108927 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.110448 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.110598 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.110809 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.112024 (+ 1215us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.112219 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21562,"thread_start_us":22976,"threads_started":1}
I20260805 23:05:42.112673 17043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34230edfd0674f44bc29420fd81e4f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:42.116657 17494 tablet_bootstrap.cc:492] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Bootstrap starting.
I20260805 23:05:42.120092 17494 tablet_bootstrap.cc:654] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:42.121590 17494 log.cc:824] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:42.123621 17215 tablet_service.cc:1467] Processing CreateTablet for tablet 34230edfd0674f44bc29420fd81e4f01 (DEFAULT_TABLE table=test-table [id=ede33417384d4cfcacf3303d8eb9df99]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:42.125602 17215 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34230edfd0674f44bc29420fd81e4f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:42.127197 17497 tablet_bootstrap.cc:492] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Bootstrap starting.
I20260805 23:05:42.131078 17497 tablet_bootstrap.cc:654] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:42.131544 17494 tablet_bootstrap.cc:492] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: No bootstrap required, opened a new log
I20260805 23:05:42.131932 17494 ts_tablet_manager.cc:1397] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Time spent bootstrapping tablet: real 0.016s user 0.010s sys 0.004s
I20260805 23:05:42.132361 17497 log.cc:824] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:42.135264 17497 tablet_bootstrap.cc:492] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: No bootstrap required, opened a new log
I20260805 23:05:42.135596 17497 ts_tablet_manager.cc:1397] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260805 23:05:42.143016 17494 raft_consensus.cc:348] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.143159 17497 raft_consensus.cc:348] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.143574 17494 raft_consensus.cc:374] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:42.143632 17497 raft_consensus.cc:374] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:42.143685 17494 raft_consensus.cc:729] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f20ba6564f204f68b92702037da6d94b, State: Initialized, Role: FOLLOWER
I20260805 23:05:42.143725 17497 raft_consensus.cc:729] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c765f9e102014ec1837ae598e45689ca, State: Initialized, Role: FOLLOWER
I20260805 23:05:42.144218 17500 tablet_bootstrap.cc:492] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Bootstrap starting.
I20260805 23:05:42.144440 17494 consensus_queue.cc:260] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.144439 17497 consensus_queue.cc:260] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.145610 17471 heartbeater.cc:503] Master 127.22.45.126:34705 was elected leader, sending a full tablet report...
I20260805 23:05:42.146807 17497 ts_tablet_manager.cc:1428] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260805 23:05:42.148169 17494 ts_tablet_manager.cc:1428] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Time spent starting tablet: real 0.016s user 0.013s sys 0.000s
I20260805 23:05:42.149334 17500 tablet_bootstrap.cc:654] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:42.150756 17500 log.cc:824] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:42.154014 17500 tablet_bootstrap.cc:492] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: No bootstrap required, opened a new log
I20260805 23:05:42.154278 17500 ts_tablet_manager.cc:1397] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260805 23:05:42.161552 17500 raft_consensus.cc:348] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.161991 17500 raft_consensus.cc:374] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:42.162089 17500 raft_consensus.cc:729] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a6e65319705493eab5662d4a9facf76, State: Initialized, Role: FOLLOWER
I20260805 23:05:42.162635 17500 consensus_queue.cc:260] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.163791 17299 heartbeater.cc:503] Master 127.22.45.126:34705 was elected leader, sending a full tablet report...
I20260805 23:05:42.164482 17500 ts_tablet_manager.cc:1428] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
W20260805 23:05:42.179252 17301 tablet.cc:2369] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:42.193646 17502 raft_consensus.cc:482] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:05:42.193988 17502 raft_consensus.cc:504] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.195940 17502 leader_election.cc:288] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f20ba6564f204f68b92702037da6d94b (127.22.45.67:39293), 3a6e65319705493eab5662d4a9facf76 (127.22.45.66:37785)
I20260805 23:05:42.204335 17491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.196592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:48931 (local address 127.22.45.67:39293)
0805 23:05:42.196806 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.196811 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.198010 (+ 1199us) server_negotiation.cc:407] Connection header received
0805 23:05:42.198230 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.198236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.198316 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.198381 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:42.199210 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.200085 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.201947 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.203234 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.203421 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.203506 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.203914 (+ 408us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.204059 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 23:05:42.204357 17493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.196603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:53441 (local address 127.22.45.66:37785)
0805 23:05:42.196812 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.196819 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.197507 (+ 688us) server_negotiation.cc:407] Connection header received
0805 23:05:42.197884 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.197889 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.197958 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.198051 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:42.198583 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.199461 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.202137 (+ 2676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.203403 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.203578 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.203674 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.203989 (+ 315us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.204116 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260805 23:05:42.204491 17507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.196592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:37785 (local address 127.22.45.65:53441)
0805 23:05:42.197367 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:42.197388 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:42.197658 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:42.198111 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:42.198127 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:42.198154 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:42.198436 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.198445 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.199607 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.199613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.201937 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.201954 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.203630 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.203636 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.203844 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.203873 (+ 29us) client_negotiation.cc:769] Sending connection context
0805 23:05:42.203954 (+ 81us) client_negotiation.cc:240] Negotiation successful
0805 23:05:42.204073 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"mutex_wait_us":25,"thread_start_us":724,"threads_started":1}
I20260805 23:05:42.204730 17509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.197061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:39293 (local address 127.22.45.65:48931)
0805 23:05:42.197877 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:42.197900 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:42.198044 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:42.198601 (+ 557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:42.198606 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:42.198631 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:42.199017 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.199028 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.200243 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.200248 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.201769 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:42.201783 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.203452 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.203458 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:42.203712 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.203755 (+ 43us) client_negotiation.cc:769] Sending connection context
0805 23:05:42.203868 (+ 113us) client_negotiation.cc:240] Negotiation successful
0805 23:05:42.204024 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"mutex_wait_us":20,"thread_start_us":491,"threads_started":1}
I20260805 23:05:42.205678 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34230edfd0674f44bc29420fd81e4f01" candidate_uuid: "c765f9e102014ec1837ae598e45689ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6e65319705493eab5662d4a9facf76" is_pre_election: true
I20260805 23:05:42.205677 17412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34230edfd0674f44bc29420fd81e4f01" candidate_uuid: "c765f9e102014ec1837ae598e45689ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ba6564f204f68b92702037da6d94b" is_pre_election: true
I20260805 23:05:42.206209 17237 raft_consensus.cc:2454] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c765f9e102014ec1837ae598e45689ca in term 0.
I20260805 23:05:42.206209 17412 raft_consensus.cc:2454] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c765f9e102014ec1837ae598e45689ca in term 0.
I20260805 23:05:42.206945 16983 leader_election.cc:302] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c765f9e102014ec1837ae598e45689ca, f20ba6564f204f68b92702037da6d94b; no voters:
I20260805 23:05:42.207378 17502 raft_consensus.cc:2781] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:05:42.207540 17502 raft_consensus.cc:482] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:05:42.207645 17502 raft_consensus.cc:3037] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:42.209980 17502 raft_consensus.cc:504] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.210654 17502 leader_election.cc:288] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [CANDIDATE]: Term 1 election: Requested vote from peers f20ba6564f204f68b92702037da6d94b (127.22.45.67:39293), 3a6e65319705493eab5662d4a9facf76 (127.22.45.66:37785)
I20260805 23:05:42.211277 17412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34230edfd0674f44bc29420fd81e4f01" candidate_uuid: "c765f9e102014ec1837ae598e45689ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f20ba6564f204f68b92702037da6d94b"
I20260805 23:05:42.211282 17237 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34230edfd0674f44bc29420fd81e4f01" candidate_uuid: "c765f9e102014ec1837ae598e45689ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a6e65319705493eab5662d4a9facf76"
I20260805 23:05:42.211486 17412 raft_consensus.cc:3037] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:42.211480 17237 raft_consensus.cc:3037] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:42.213842 17412 raft_consensus.cc:2454] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c765f9e102014ec1837ae598e45689ca in term 1.
I20260805 23:05:42.213838 17237 raft_consensus.cc:2454] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c765f9e102014ec1837ae598e45689ca in term 1.
I20260805 23:05:42.214365 16981 leader_election.cc:302] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a6e65319705493eab5662d4a9facf76, c765f9e102014ec1837ae598e45689ca; no voters:
I20260805 23:05:42.214735 17502 raft_consensus.cc:2781] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:42.215227 17502 raft_consensus.cc:686] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 1 LEADER]: Becoming Leader. State: Replica: c765f9e102014ec1837ae598e45689ca, State: Running, Role: LEADER
I20260805 23:05:42.215976 17502 consensus_queue.cc:237] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } }
I20260805 23:05:42.221336 16872 catalog_manager.cc:5495] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca reported cstate change: term changed from 0 to 1, leader changed from <none> to c765f9e102014ec1837ae598e45689ca (127.22.45.65). New cstate: current_term: 1 leader_uuid: "c765f9e102014ec1837ae598e45689ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c765f9e102014ec1837ae598e45689ca" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 41087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 } health_report { overall_health: UNKNOWN } } }
W20260805 23:05:42.240268 17472 tablet.cc:2369] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:42.269799 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.264264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60520 (local address 127.22.45.65:41087)
0805 23:05:42.264461 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.264467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.264557 (+ 90us) server_negotiation.cc:407] Connection header received
0805 23:05:42.264801 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.264805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.264888 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.265037 (+ 149us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:05:42.265402 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.266152 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.267619 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.268033 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.268145 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.268685 (+ 540us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:05:42.269267 (+ 582us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:05:42.269396 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.269445 (+ 49us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.269566 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260805 23:05:42.278874 17412 raft_consensus.cc:1261] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 1 FOLLOWER]: Refusing update from remote peer c765f9e102014ec1837ae598e45689ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:42.278874 17237 raft_consensus.cc:1261] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 1 FOLLOWER]: Refusing update from remote peer c765f9e102014ec1837ae598e45689ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:42.280217 17510 consensus_queue.cc:1035] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a6e65319705493eab5662d4a9facf76" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 37785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:42.280630 17502 consensus_queue.cc:1035] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "f20ba6564f204f68b92702037da6d94b" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 39293 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:42.310804 16871 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:42.311210 16871 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60634:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:42.315543 16871 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3d29feb6dbeb46f09ef3b80cace95866: Sending DeleteTablet for 3 replicas of tablet 34230edfd0674f44bc29420fd81e4f01
I20260805 23:05:42.316965 17388 tablet_service.cc:1514] Processing DeleteTablet for tablet 34230edfd0674f44bc29420fd81e4f01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:42 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:36148
I20260805 23:05:42.317029 17215 tablet_service.cc:1514] Processing DeleteTablet for tablet 34230edfd0674f44bc29420fd81e4f01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:42 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:36052
I20260805 23:05:42.317364 17043 tablet_service.cc:1514] Processing DeleteTablet for tablet 34230edfd0674f44bc29420fd81e4f01 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:42 UTC) from {username='kudu', principal='kudu/127.22.45.126@KRBTEST.COM'} at 127.0.0.1:60512
I20260805 23:05:42.319444 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 16960
I20260805 23:05:42.329463 17537 tablet_replica.cc:330] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: stopping tablet replica
I20260805 23:05:42.329475 17532 tablet_replica.cc:330] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: stopping tablet replica
I20260805 23:05:42.330205 17537 raft_consensus.cc:2229] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:05:42.331287 17537 raft_consensus.cc:2258] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:42.330849 17532 raft_consensus.cc:2229] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:42.332115 17532 raft_consensus.cc:2258] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:42.333536 17535 tablet_replica.cc:330] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: stopping tablet replica
I20260805 23:05:42.334466 17537 ts_tablet_manager.cc:1905] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:42.335736 17532 ts_tablet_manager.cc:1905] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:42.337196 17535 raft_consensus.cc:2229] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:42.340188 17535 raft_consensus.cc:2258] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:42.343678 17532 ts_tablet_manager.cc:1918] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:42.343681 17537 ts_tablet_manager.cc:1918] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:42.343899 17537 log.cc:1196] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-0/wal/wals/34230edfd0674f44bc29420fd81e4f01
Aug 05 23:05:42 dist-test-slave-1vmg krb5kdc[16811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.65@KRBTEST.COM
I20260805 23:05:42.346143 17537 ts_tablet_manager.cc:1939] T 34230edfd0674f44bc29420fd81e4f01 P c765f9e102014ec1837ae598e45689ca: Deleting consensus metadata
I20260805 23:05:42.348042 17535 ts_tablet_manager.cc:1905] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:42.348819 17532 log.cc:1196] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/34230edfd0674f44bc29420fd81e4f01
I20260805 23:05:42.349972 17532 ts_tablet_manager.cc:1939] T 34230edfd0674f44bc29420fd81e4f01 P f20ba6564f204f68b92702037da6d94b: Deleting consensus metadata
I20260805 23:05:42.352157 16854 catalog_manager.cc:4841] TS f20ba6564f204f68b92702037da6d94b (127.22.45.67:39293): tablet 34230edfd0674f44bc29420fd81e4f01 (table test-table [id=ede33417384d4cfcacf3303d8eb9df99]) successfully deleted
I20260805 23:05:42.355353 16850 catalog_manager.cc:4841] TS c765f9e102014ec1837ae598e45689ca (127.22.45.65:41087): tablet 34230edfd0674f44bc29420fd81e4f01 (table test-table [id=ede33417384d4cfcacf3303d8eb9df99]) successfully deleted
I20260805 23:05:42.357199 17535 ts_tablet_manager.cc:1918] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:42.357477 17535 log.cc:1196] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/34230edfd0674f44bc29420fd81e4f01
I20260805 23:05:42.358124 17535 ts_tablet_manager.cc:1939] T 34230edfd0674f44bc29420fd81e4f01 P 3a6e65319705493eab5662d4a9facf76: Deleting consensus metadata
I20260805 23:05:42.360224 16850 catalog_manager.cc:4841] TS 3a6e65319705493eab5662d4a9facf76 (127.22.45.66:37785): tablet 34230edfd0674f44bc29420fd81e4f01 (table test-table [id=ede33417384d4cfcacf3303d8eb9df99]) successfully deleted
I20260805 23:05:42.362532 17490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.321253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60536 (local address 127.22.45.65:41087)
0805 23:05:42.321466 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.321473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.329724 (+ 8251us) server_negotiation.cc:407] Connection header received
0805 23:05:42.330125 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.330132 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.330223 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.330310 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:42.332372 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.334793 (+ 2421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.337745 (+ 2952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.338482 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.338601 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.347171 (+ 8570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:42.347188 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:42.347209 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:42.347277 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:42.357722 (+ 10445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.358874 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.358884 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.358887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.359145 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.359684 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.359689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.359692 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.360233 (+ 541us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:42.361662 (+ 1429us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.361829 (+ 167us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.362117 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260805 23:05:42.363402 17121 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:42.479187 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 16960
I20260805 23:05:42.503134 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 17133
Aug 05 23:05:42 dist-test-slave-1vmg krb5kdc[16811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.66@KRBTEST.COM
I20260805 23:05:42.518761 17493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.503891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36056 (local address 127.22.45.66:37785)
0805 23:05:42.504106 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.504111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.504130 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:05:42.504259 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.504264 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.504329 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.504424 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:42.505873 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.506675 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.508093 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.508521 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.508651 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.513117 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:42.513138 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:42.513156 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:42.513201 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:42.516064 (+ 2863us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.516863 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.516870 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.516872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.517003 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.517325 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.517327 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.517330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.517759 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:42.517998 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.518227 (+ 229us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.518416 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260805 23:05:42.519567 17290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:42.609586 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 17133
I20260805 23:05:42.629191 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 17307
Aug 05 23:05:42 dist-test-slave-1vmg krb5kdc[16811](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971139, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.67@KRBTEST.COM
I20260805 23:05:42.645591 17491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:42.630080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36154 (local address 127.22.45.67:39293)
0805 23:05:42.630246 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:42.630251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:42.630272 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:05:42.630330 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:42.630333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:42.630399 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:42.630482 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:42.631913 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.632669 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.633999 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:42.634424 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:42.634523 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:42.639614 (+ 5091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:42.639644 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:42.639662 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:42.639710 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:42.642528 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.643638 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.643648 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.643650 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.643832 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:42.644173 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:42.644177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:42.644179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:42.644604 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:42.644865 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:42.645091 (+ 226us) server_negotiation.cc:299] Negotiation successful
0805 23:05:42.645307 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260805 23:05:42.646329 17462 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:42.737149 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 17307
I20260805 23:05:42.758165 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 16831
I20260805 23:05:42.759392 16913 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:42.871726 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 16831
2026-08-05T23:05:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4751 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-05T23:05:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:42Z Disabled control of system clock
I20260805 23:05:42.970132 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35583
--webserver_interface=127.22.45.126
--webserver_port=0
--builtin_ntp_servers=127.22.45.84:43905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:35583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 23:05:43.339514 17549 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:43.339891 17549 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:43.340030 17549 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:43.347738 17549 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:43.347906 17549 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:43.347977 17549 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:43.348068 17549 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:43.348129 17549 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:43.358132 17549 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:35583
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:43.359666 17549 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:43.361706 17549 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:43.374567 17557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:43.374666 17563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:43.374532 17559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:43.375658 17549 server_base.cc:1034] running on GCE node
I20260805 23:05:43.376595 17549 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:43.378238 17549 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:43.379452 17549 hybrid_clock.cc:648] HybridClock initialized: now 1785971143379407 us; error 38 us; skew 500 ppm
I20260805 23:05:43.379880 17549 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:43.382524 17549 webserver.cc:460] Webserver started at http://127.22.45.126:44161/ using document root <none> and password file <none>
I20260805 23:05:43.383376 17549 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:43.383512 17549 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:43.383876 17549 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:43.387305 17549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "5a603aebf5414e9c9c6e3795c73afbce"
format_stamp: "Formatted at 2026-08-05 23:05:43 on dist-test-slave-1vmg"
server_key: "6e41b956517288b06d20ed572beade7a"
server_key_iv: "33097078f16d9a0b3ca325f10b826dfc"
server_key_version: "encryptionkey@0"
I20260805 23:05:43.388312 17549 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "5a603aebf5414e9c9c6e3795c73afbce"
format_stamp: "Formatted at 2026-08-05 23:05:43 on dist-test-slave-1vmg"
server_key: "6e41b956517288b06d20ed572beade7a"
server_key_iv: "33097078f16d9a0b3ca325f10b826dfc"
server_key_version: "encryptionkey@0"
I20260805 23:05:43.394675 17549 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260805 23:05:43.399010 17570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:43.400641 17549 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:43.400853 17549 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "5a603aebf5414e9c9c6e3795c73afbce"
format_stamp: "Formatted at 2026-08-05 23:05:43 on dist-test-slave-1vmg"
server_key: "6e41b956517288b06d20ed572beade7a"
server_key_iv: "33097078f16d9a0b3ca325f10b826dfc"
server_key_version: "encryptionkey@0"
I20260805 23:05:43.401108 17549 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:43.417593 17549 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:43.418576 17549 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:43.418885 17549 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:43.437498 17549 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:35583
I20260805 23:05:43.437525 17635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:35583 every 8 connection(s)
I20260805 23:05:43.439136 17549 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:43.443063 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 17549
I20260805 23:05:43.443246 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:43.443725 22709 external_mini_cluster.cc:1428] Setting key 446b937c7b58a29a470ac77d01c0f450
I20260805 23:05:43.443739 17636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:43.461172 17636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce: Bootstrap starting.
I20260805 23:05:43.461172 17643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:43.445885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60584 (local address 127.22.45.126:35583)
0805 23:05:43.447235 (+ 1350us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:43.447256 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:43.447332 (+ 76us) server_negotiation.cc:407] Connection header received
0805 23:05:43.449460 (+ 2128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:43.449502 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:43.450345 (+ 843us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:43.450973 (+ 628us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:43.451697 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:43.453811 (+ 2114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:43.455278 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:43.456406 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:43.456624 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:43.457902 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:43.457913 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:43.457938 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:43.458809 (+ 871us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:43.458949 (+ 140us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:43.458980 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:43.459103 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:43.459308 (+ 205us) server_negotiation.cc:299] Negotiation successful
0805 23:05:43.459708 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":676,"thread_start_us":407,"threads_started":1}
I20260805 23:05:43.464989 17636 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:43.466122 17636 log.cc:824] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:43.469594 17636 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce: No bootstrap required, opened a new log
I20260805 23:05:43.477598 17636 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a603aebf5414e9c9c6e3795c73afbce" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35583 } }
I20260805 23:05:43.478051 17636 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:43.478139 17636 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a603aebf5414e9c9c6e3795c73afbce, State: Initialized, Role: FOLLOWER
I20260805 23:05:43.478696 17636 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a603aebf5414e9c9c6e3795c73afbce" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35583 } }
I20260805 23:05:43.479005 17636 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:43.479172 17636 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:43.479379 17636 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:43.482172 17636 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a603aebf5414e9c9c6e3795c73afbce" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35583 } }
I20260805 23:05:43.482800 17636 leader_election.cc:302] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a603aebf5414e9c9c6e3795c73afbce; no voters:
I20260805 23:05:43.483500 17636 leader_election.cc:288] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:43.483665 17645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:43.484431 17645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [term 1 LEADER]: Becoming Leader. State: Replica: 5a603aebf5414e9c9c6e3795c73afbce, State: Running, Role: LEADER
I20260805 23:05:43.484992 17645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a603aebf5414e9c9c6e3795c73afbce" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35583 } }
I20260805 23:05:43.485725 17636 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:43.488124 17648 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a603aebf5414e9c9c6e3795c73afbce. Latest consensus state: current_term: 1 leader_uuid: "5a603aebf5414e9c9c6e3795c73afbce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a603aebf5414e9c9c6e3795c73afbce" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35583 } } }
I20260805 23:05:43.488648 17648 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:43.488101 17647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a603aebf5414e9c9c6e3795c73afbce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a603aebf5414e9c9c6e3795c73afbce" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35583 } } }
I20260805 23:05:43.489550 17647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:43.491809 17657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:43.497309 17657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:43.508517 17657 catalog_manager.cc:1347] Generated new cluster ID: c120b396b0bf43c982d78732e25a8eb3
I20260805 23:05:43.508669 17657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:43.544950 17657 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:43.546868 17657 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:43.554517 17657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce: Generated new TSK 0
I20260805 23:05:43.555725 17657 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:43.563675 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.65:0
--local_ip_for_outbound_sockets=127.22.45.65
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35583
--builtin_ntp_servers=127.22.45.84:43905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260805 23:05:43.930600 17671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:43.931005 17671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:43.931128 17671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:43.938885 17671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:43.939060 17671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:43.939216 17671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.65
I20260805 23:05:43.949747 17671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.45.65
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.65
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:43.951316 17671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:43.953425 17671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:43.968009 17680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:43.968218 17681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:43.968000 17683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:43.972576 17671 server_base.cc:1034] running on GCE node
I20260805 23:05:43.973361 17671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:43.974563 17671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:43.975826 17671 hybrid_clock.cc:648] HybridClock initialized: now 1785971143975750 us; error 74 us; skew 500 ppm
I20260805 23:05:43.976341 17671 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:43.979197 17671 webserver.cc:460] Webserver started at http://127.22.45.65:37753/ using document root <none> and password file <none>
I20260805 23:05:43.980064 17671 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:43.980180 17671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:43.980538 17671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:43.984012 17671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data/instance:
uuid: "29a376c9305445429d6fce32b89e850c"
format_stamp: "Formatted at 2026-08-05 23:05:43 on dist-test-slave-1vmg"
server_key: "3815cc573424e94335469e1cf2345d4e"
server_key_iv: "0010b05fd3145f03450b69692ec2895a"
server_key_version: "encryptionkey@0"
I20260805 23:05:43.984997 17671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance:
uuid: "29a376c9305445429d6fce32b89e850c"
format_stamp: "Formatted at 2026-08-05 23:05:43 on dist-test-slave-1vmg"
server_key: "3815cc573424e94335469e1cf2345d4e"
server_key_iv: "0010b05fd3145f03450b69692ec2895a"
server_key_version: "encryptionkey@0"
I20260805 23:05:43.991664 17671 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 23:05:43.996462 17690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:43.998106 17671 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260805 23:05:43.998363 17671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/wal
uuid: "29a376c9305445429d6fce32b89e850c"
format_stamp: "Formatted at 2026-08-05 23:05:43 on dist-test-slave-1vmg"
server_key: "3815cc573424e94335469e1cf2345d4e"
server_key_iv: "0010b05fd3145f03450b69692ec2895a"
server_key_version: "encryptionkey@0"
I20260805 23:05:43.998664 17671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:44.024238 17671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:44.025148 17671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:44.025461 17671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:44.026551 17671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:44.028380 17671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:44.028489 17671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:44.028573 17671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:44.028635 17671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:44.066730 17671 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.65:39493
I20260805 23:05:44.066804 17850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.65:39493 every 8 connection(s)
I20260805 23:05:44.068122 17671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/data/info.pb
I20260805 23:05:44.070829 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 17671
I20260805 23:05:44.071038 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-0/wal/instance
I20260805 23:05:44.071610 22709 external_mini_cluster.cc:1428] Setting key 123fe67d1e0ec3691f6cb436d81e7764
I20260805 23:05:44.074342 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.66:0
--local_ip_for_outbound_sockets=127.22.45.66
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35583
--builtin_ntp_servers=127.22.45.84:43905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 23:05:44.081789 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:44.071128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.65:35341 (local address 127.22.45.126:35583)
0805 23:05:44.071648 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:44.071655 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:44.072915 (+ 1260us) server_negotiation.cc:407] Connection header received
0805 23:05:44.074849 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:44.074855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:44.074984 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:44.075086 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:44.076242 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.077090 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.078786 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.079278 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.079404 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:44.080894 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:44.080899 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:44.080903 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:44.080923 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:44.080966 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:44.080978 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:44.081057 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:44.081298 (+ 241us) server_negotiation.cc:299] Negotiation successful
0805 23:05:44.081414 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":245,"threads_started":1}
I20260805 23:05:44.083029 17857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:44.071666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35583 (local address 127.22.45.65:35341)
0805 23:05:44.072744 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:44.072793 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:44.074568 (+ 1775us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:44.075339 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:44.075348 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:44.075441 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:44.076060 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:44.076080 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.077293 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.077298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:44.078623 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:44.078639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.079522 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.079530 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:44.079807 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:44.080533 (+ 726us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:44.080536 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:44.080581 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:44.080678 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:44.081077 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:44.081089 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:44.081096 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 23:05:44.081270 (+ 174us) client_negotiation.cc:240] Negotiation successful
0805 23:05:44.081737 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":323,"threads_started":1}
I20260805 23:05:44.084861 17851 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35583
I20260805 23:05:44.085203 17851 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:44.086186 17851 heartbeater.cc:511] Master 127.22.45.126:35583 requested a full tablet report, sending...
I20260805 23:05:44.088734 17591 ts_manager.cc:194] Registered new tserver with Master: 29a376c9305445429d6fce32b89e850c (127.22.45.65:39493)
I20260805 23:05:44.090413 17591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.65:35341
W20260805 23:05:44.431838 17858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:44.432224 17858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:44.432353 17858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:44.441896 17858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:44.442057 17858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:44.442238 17858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.66
I20260805 23:05:44.457553 17858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.45.66
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.66
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:44.459379 17858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:44.461711 17858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:44.476006 17864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:44.475950 17867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:44.475919 17865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:44.476963 17858 server_base.cc:1034] running on GCE node
I20260805 23:05:44.477725 17858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:44.478873 17858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:44.480150 17858 hybrid_clock.cc:648] HybridClock initialized: now 1785971144480088 us; error 58 us; skew 500 ppm
I20260805 23:05:44.480528 17858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:44.483328 17858 webserver.cc:460] Webserver started at http://127.22.45.66:40153/ using document root <none> and password file <none>
I20260805 23:05:44.484164 17858 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:44.484273 17858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:44.484619 17858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:44.488036 17858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data/instance:
uuid: "a881aa3f1bb54bf0acead575a708a557"
format_stamp: "Formatted at 2026-08-05 23:05:44 on dist-test-slave-1vmg"
server_key: "d0f67e4d1037a7bedb9d466647066585"
server_key_iv: "a595e391f524e1100785bb5475bd7efb"
server_key_version: "encryptionkey@0"
I20260805 23:05:44.488935 17858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance:
uuid: "a881aa3f1bb54bf0acead575a708a557"
format_stamp: "Formatted at 2026-08-05 23:05:44 on dist-test-slave-1vmg"
server_key: "d0f67e4d1037a7bedb9d466647066585"
server_key_iv: "a595e391f524e1100785bb5475bd7efb"
server_key_version: "encryptionkey@0"
I20260805 23:05:44.494982 17858 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260805 23:05:44.499006 17875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:44.500483 17858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:44.500669 17858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal
uuid: "a881aa3f1bb54bf0acead575a708a557"
format_stamp: "Formatted at 2026-08-05 23:05:44 on dist-test-slave-1vmg"
server_key: "d0f67e4d1037a7bedb9d466647066585"
server_key_iv: "a595e391f524e1100785bb5475bd7efb"
server_key_version: "encryptionkey@0"
I20260805 23:05:44.500896 17858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:44.514253 17858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:44.515278 17858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:44.515596 17858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:44.516695 17858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:44.518505 17858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:44.518635 17858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:44.518757 17858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:44.518836 17858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:44.551534 17858 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.66:34635
I20260805 23:05:44.551584 18043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.66:34635 every 8 connection(s)
I20260805 23:05:44.553035 17858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/data/info.pb
I20260805 23:05:44.559298 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 17858
I20260805 23:05:44.559487 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal/instance
I20260805 23:05:44.560029 22709 external_mini_cluster.cc:1428] Setting key fadc54673a1d8d94f1b76c4c6d2c4faf
I20260805 23:05:44.563006 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.45.67:0
--local_ip_for_outbound_sockets=127.22.45.67
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35583
--builtin_ntp_servers=127.22.45.84:43905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260805 23:05:44.566480 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:44.555855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.66:52229 (local address 127.22.45.126:35583)
0805 23:05:44.556041 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:44.556045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:44.557546 (+ 1501us) server_negotiation.cc:407] Connection header received
0805 23:05:44.559431 (+ 1885us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:44.559438 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:44.559540 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:44.559663 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:44.560895 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.561711 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.563532 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.564138 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.564271 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:44.565670 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:44.565676 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:44.565680 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:44.565705 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:44.565748 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:44.565763 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:44.565846 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:44.566041 (+ 195us) server_negotiation.cc:299] Negotiation successful
0805 23:05:44.566162 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 23:05:44.567610 18050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:44.556434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35583 (local address 127.22.45.66:52229)
0805 23:05:44.557372 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:44.557417 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:44.559131 (+ 1714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:44.559888 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:44.559896 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:44.559990 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:44.560700 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:44.560741 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.561898 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.561903 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:44.563362 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:44.563377 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:44.564340 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:44.564345 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:44.564557 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:44.565307 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:44.565309 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:44.565355 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:44.565450 (+ 95us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:44.565855 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:44.565861 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:44.565868 (+ 7us) client_negotiation.cc:769] Sending connection context
0805 23:05:44.566011 (+ 143us) client_negotiation.cc:240] Negotiation successful
0805 23:05:44.566362 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":287,"threads_started":1}
I20260805 23:05:44.569245 18044 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35583
I20260805 23:05:44.569557 18044 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:44.570396 18044 heartbeater.cc:511] Master 127.22.45.126:35583 requested a full tablet report, sending...
I20260805 23:05:44.572086 17591 ts_manager.cc:194] Registered new tserver with Master: a881aa3f1bb54bf0acead575a708a557 (127.22.45.66:34635)
I20260805 23:05:44.573160 17591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.66:52229
W20260805 23:05:44.924623 18051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:44.924966 18051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:44.925096 18051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:44.933143 18051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:44.933301 18051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:44.933459 18051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.45.67
I20260805 23:05:44.943292 18051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:43905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.45.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.45.67
--webserver_port=0
--tserver_master_addrs=127.22.45.126:35583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.45.67
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:44.944689 18051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:44.946624 18051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:44.960631 18057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:44.960716 18058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:44.961138 18060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:44.961854 18051 server_base.cc:1034] running on GCE node
I20260805 23:05:44.962565 18051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:44.963703 18051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:44.964939 18051 hybrid_clock.cc:648] HybridClock initialized: now 1785971144964886 us; error 49 us; skew 500 ppm
I20260805 23:05:44.965312 18051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260805 23:05:44.968132 18051 webserver.cc:460] Webserver started at http://127.22.45.67:34863/ using document root <none> and password file <none>
I20260805 23:05:44.968950 18051 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:44.969070 18051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:44.969413 18051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:44.972828 18051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data/instance:
uuid: "490e9aff3a894562b4a7f04fccac7bee"
format_stamp: "Formatted at 2026-08-05 23:05:44 on dist-test-slave-1vmg"
server_key: "808f385df59f332901d336e7e1e068d6"
server_key_iv: "08bb16c8d60bb283dd94bba3b3f52e99"
server_key_version: "encryptionkey@0"
I20260805 23:05:44.973820 18051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance:
uuid: "490e9aff3a894562b4a7f04fccac7bee"
format_stamp: "Formatted at 2026-08-05 23:05:44 on dist-test-slave-1vmg"
server_key: "808f385df59f332901d336e7e1e068d6"
server_key_iv: "08bb16c8d60bb283dd94bba3b3f52e99"
server_key_version: "encryptionkey@0"
I20260805 23:05:44.980286 18051 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:05:44.984395 18068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:44.986033 18051 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:05:44.986234 18051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal
uuid: "490e9aff3a894562b4a7f04fccac7bee"
format_stamp: "Formatted at 2026-08-05 23:05:44 on dist-test-slave-1vmg"
server_key: "808f385df59f332901d336e7e1e068d6"
server_key_iv: "08bb16c8d60bb283dd94bba3b3f52e99"
server_key_version: "encryptionkey@0"
I20260805 23:05:44.986479 18051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:45.003444 18051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:45.004738 18051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:45.005239 18051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:45.006625 18051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260805 23:05:45.008455 18051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260805 23:05:45.008574 18051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:45.008706 18051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260805 23:05:45.008782 18051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:45.046474 18051 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.67:45011
I20260805 23:05:45.046510 18220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.67:45011 every 8 connection(s)
I20260805 23:05:45.048058 18051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/data/info.pb
I20260805 23:05:45.058133 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 18051
I20260805 23:05:45.058357 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal/instance
I20260805 23:05:45.058813 22709 external_mini_cluster.cc:1428] Setting key aaa51277dfb519032bf91ccdcbca42fc
I20260805 23:05:45.062410 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.050990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:34227 (local address 127.22.45.126:35583)
0805 23:05:45.051218 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.051223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.052774 (+ 1551us) server_negotiation.cc:407] Connection header received
0805 23:05:45.054755 (+ 1981us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.054763 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.054854 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.055005 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:45.056315 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.057137 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.059163 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.059834 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.059964 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.061513 (+ 1549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:45.061518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:45.061521 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:45.061548 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:45.061584 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:45.061596 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:45.061677 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.061919 (+ 242us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.062036 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 23:05:45.063628 18223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.051532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:35583 (local address 127.22.45.67:34227)
0805 23:05:45.052568 (+ 1036us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.052619 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:45.054364 (+ 1745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:45.055288 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:45.055298 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:45.055409 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:05:45.056108 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.056128 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.057312 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.057316 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.058965 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.058987 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.060118 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.060126 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.060385 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.061151 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0805 23:05:45.061153 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:05:45.061202 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0805 23:05:45.061302 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:05:45.061695 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:05:45.061707 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:05:45.061716 (+ 9us) client_negotiation.cc:769] Sending connection context
0805 23:05:45.061894 (+ 178us) client_negotiation.cc:240] Negotiation successful
0805 23:05:45.062388 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":323,"threads_started":1}
I20260805 23:05:45.065160 18221 heartbeater.cc:347] Connected to a master server at 127.22.45.126:35583
I20260805 23:05:45.065487 18221 heartbeater.cc:464] Registering TS with master...
I20260805 23:05:45.066393 18221 heartbeater.cc:511] Master 127.22.45.126:35583 requested a full tablet report, sending...
I20260805 23:05:45.068055 17591 ts_manager.cc:194] Registered new tserver with Master: 490e9aff3a894562b4a7f04fccac7bee (127.22.45.67:45011)
I20260805 23:05:45.068969 17591 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.45.67:34227
I20260805 23:05:45.074476 22709 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260805 23:05:45.085448 17854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.079089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42414 (local address 127.22.45.126:35583)
0805 23:05:45.079317 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.079322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.079842 (+ 520us) server_negotiation.cc:407] Connection header received
0805 23:05:45.080027 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.080031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.080111 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.080198 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:45.080679 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.081438 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.082896 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.083429 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.083541 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.084784 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:45.084789 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:45.084793 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:45.084817 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:45.084856 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:45.084869 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:45.084950 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.085040 (+ 90us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.085137 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 23:05:45.094724 17851 heartbeater.cc:503] Master 127.22.45.126:35583 was elected leader, sending a full tablet report...
I20260805 23:05:45.090188 17591 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42414:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260805 23:05:45.098364 17591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260805 23:05:45.126063 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.113602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:34635 (local address 127.0.0.1:52890)
0805 23:05:45.115117 (+ 1515us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.115172 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:45.115394 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:45.116344 (+ 950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:45.116354 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:45.116393 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:45.116882 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.116897 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.119361 (+ 2464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.119369 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.122233 (+ 2864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.122268 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.124815 (+ 2547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.124824 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.125136 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.125211 (+ 75us) client_negotiation.cc:769] Sending connection context
0805 23:05:45.125377 (+ 166us) client_negotiation.cc:240] Negotiation successful
0805 23:05:45.125628 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1191,"thread_start_us":368,"threads_started":1}
I20260805 23:05:45.131163 18238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.113864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.22.45.66:34635)
0805 23:05:45.114563 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.114574 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.115609 (+ 1035us) server_negotiation.cc:407] Connection header received
0805 23:05:45.115736 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.115744 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.116048 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.117139 (+ 1091us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:45.117430 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.119160 (+ 1730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.122656 (+ 3496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.124474 (+ 1818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.130311 (+ 5837us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.130571 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.130647 (+ 76us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.130812 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":393,"threads_started":1}
I20260805 23:05:45.135087 18236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.114877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33422)
0805 23:05:45.126457 (+ 11580us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.126483 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:45.126649 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:45.128016 (+ 1367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:45.128022 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:45.128059 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:45.128311 (+ 252us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.128326 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.130243 (+ 1917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.130249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.132144 (+ 1895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.132160 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.134169 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.134176 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.134396 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.134434 (+ 38us) client_negotiation.cc:769] Sending connection context
0805 23:05:45.134542 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 23:05:45.134732 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11420,"thread_start_us":12666,"threads_started":1}
I20260805 23:05:45.135308 18239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.114492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33422 (local address 127.22.45.65:39493)
0805 23:05:45.115067 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.115075 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.127146 (+ 12071us) server_negotiation.cc:407] Connection header received
0805 23:05:45.127312 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.127323 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.127704 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.128524 (+ 820us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:45.128838 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.130073 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.132388 (+ 2315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.133973 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.134124 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.134435 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.134700 (+ 265us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.134944 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":553,"threads_started":1}
I20260805 23:05:45.135947 17948 tablet_service.cc:1467] Processing CreateTablet for tablet 03ecebe6c79b4819962b69f19407772e (DEFAULT_TABLE table=test-table [id=88472a6743894d47b8eeea886aefc879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:45.137239 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.115681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.67:45011 (local address 127.0.0.1:37638)
0805 23:05:45.127240 (+ 11559us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.127266 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:45.127430 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:45.128912 (+ 1482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:45.128916 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:45.128939 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:45.129334 (+ 395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.129347 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.131416 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.131422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.133568 (+ 2146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.133585 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.135956 (+ 2371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.135964 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.136163 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.136205 (+ 42us) client_negotiation.cc:769] Sending connection context
0805 23:05:45.136329 (+ 124us) client_negotiation.cc:240] Negotiation successful
0805 23:05:45.136489 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11398,"thread_start_us":12557,"threads_started":1}
I20260805 23:05:45.137759 17948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ecebe6c79b4819962b69f19407772e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:45.139657 17762 tablet_service.cc:1467] Processing CreateTablet for tablet 03ecebe6c79b4819962b69f19407772e (DEFAULT_TABLE table=test-table [id=88472a6743894d47b8eeea886aefc879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:45.140673 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.115542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37638 (local address 127.22.45.67:45011)
0805 23:05:45.128364 (+ 12822us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.128370 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.128402 (+ 32us) server_negotiation.cc:407] Connection header received
0805 23:05:45.128481 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.128487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.128665 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.129554 (+ 889us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:45.129787 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.131251 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.133870 (+ 2619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.135476 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.135892 (+ 416us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.136209 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.136375 (+ 166us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.136567 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12644,"thread_start_us":12461,"threads_started":1}
I20260805 23:05:45.141134 17762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ecebe6c79b4819962b69f19407772e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:45.145530 18136 tablet_service.cc:1467] Processing CreateTablet for tablet 03ecebe6c79b4819962b69f19407772e (DEFAULT_TABLE table=test-table [id=88472a6743894d47b8eeea886aefc879]), partition=RANGE (key) PARTITION UNBOUNDED
I20260805 23:05:45.147353 18136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ecebe6c79b4819962b69f19407772e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:45.150764 18243 tablet_bootstrap.cc:492] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Bootstrap starting.
I20260805 23:05:45.154593 18243 tablet_bootstrap.cc:654] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:45.156003 18243 log.cc:824] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:45.156561 18246 tablet_bootstrap.cc:492] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: Bootstrap starting.
I20260805 23:05:45.160310 18246 tablet_bootstrap.cc:654] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:45.160809 18243 tablet_bootstrap.cc:492] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: No bootstrap required, opened a new log
I20260805 23:05:45.161150 18243 ts_tablet_manager.cc:1397] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260805 23:05:45.161701 18246 log.cc:824] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:45.164361 18251 tablet_bootstrap.cc:492] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Bootstrap starting.
I20260805 23:05:45.164883 18246 tablet_bootstrap.cc:492] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: No bootstrap required, opened a new log
I20260805 23:05:45.165205 18246 ts_tablet_manager.cc:1397] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260805 23:05:45.168454 18251 tablet_bootstrap.cc:654] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:45.169869 18251 log.cc:824] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:45.170439 18243 raft_consensus.cc:348] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.170979 18243 raft_consensus.cc:374] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:45.171108 18243 raft_consensus.cc:729] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a881aa3f1bb54bf0acead575a708a557, State: Initialized, Role: FOLLOWER
I20260805 23:05:45.171808 18243 consensus_queue.cc:260] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.173010 18044 heartbeater.cc:503] Master 127.22.45.126:35583 was elected leader, sending a full tablet report...
I20260805 23:05:45.173730 18243 ts_tablet_manager.cc:1428] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Time spent starting tablet: real 0.012s user 0.014s sys 0.000s
I20260805 23:05:45.174362 18251 tablet_bootstrap.cc:492] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: No bootstrap required, opened a new log
I20260805 23:05:45.174679 18251 ts_tablet_manager.cc:1397] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260805 23:05:45.175257 18246 raft_consensus.cc:348] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.175621 18246 raft_consensus.cc:374] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:45.175716 18246 raft_consensus.cc:729] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a376c9305445429d6fce32b89e850c, State: Initialized, Role: FOLLOWER
I20260805 23:05:45.176364 18246 consensus_queue.cc:260] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.178246 18246 ts_tablet_manager.cc:1428] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260805 23:05:45.184237 18251 raft_consensus.cc:348] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.184648 18251 raft_consensus.cc:374] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:45.184751 18251 raft_consensus.cc:729] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 490e9aff3a894562b4a7f04fccac7bee, State: Initialized, Role: FOLLOWER
I20260805 23:05:45.185313 18251 consensus_queue.cc:260] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.186359 18221 heartbeater.cc:503] Master 127.22.45.126:35583 was elected leader, sending a full tablet report...
I20260805 23:05:45.187119 18251 ts_tablet_manager.cc:1428] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20260805 23:05:45.231132 18259 raft_consensus.cc:482] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260805 23:05:45.231455 18259 raft_consensus.cc:504] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.233297 18259 leader_election.cc:288] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a881aa3f1bb54bf0acead575a708a557 (127.22.45.66:34635), 29a376c9305445429d6fce32b89e850c (127.22.45.65:39493)
I20260805 23:05:45.240609 18239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.233964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:49545 (local address 127.22.45.65:39493)
0805 23:05:45.234187 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.234193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.234270 (+ 77us) server_negotiation.cc:407] Connection header received
0805 23:05:45.234575 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.234581 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.234684 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.234799 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:45.235380 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.236350 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.238312 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.239455 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.239610 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.239670 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.240263 (+ 593us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.240384 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260805 23:05:45.240695 18223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.233711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.22.45.67:49545)
0805 23:05:45.234157 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.234185 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:45.234364 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:45.234941 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:45.234947 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:45.234983 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:45.235189 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.235201 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.236505 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.236511 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.238097 (+ 1586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.238112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.239706 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.239715 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.240030 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.240074 (+ 44us) client_negotiation.cc:769] Sending connection context
0805 23:05:45.240188 (+ 114us) client_negotiation.cc:240] Negotiation successful
0805 23:05:45.240351 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241}
I20260805 23:05:45.241858 18260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.233748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.66:34635 (local address 127.22.45.67:35185)
0805 23:05:45.234717 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.234735 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0805 23:05:45.234868 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:05:45.235283 (+ 415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:05:45.235286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:05:45.235313 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0805 23:05:45.235783 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.235796 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.236958 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.236962 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.238833 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:05:45.238849 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.241099 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.241106 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:05:45.241249 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.241274 (+ 25us) client_negotiation.cc:769] Sending connection context
0805 23:05:45.241359 (+ 85us) client_negotiation.cc:240] Negotiation successful
0805 23:05:45.241501 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"mutex_wait_us":3,"thread_start_us":592,"threads_started":1}
I20260805 23:05:45.241882 18238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.234006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.45.67:35185 (local address 127.22.45.66:34635)
0805 23:05:45.234205 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.234210 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.234845 (+ 635us) server_negotiation.cc:407] Connection header received
0805 23:05:45.235046 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.235052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.235146 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.235254 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0805 23:05:45.235967 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.236778 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.239233 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.240696 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.240883 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.240958 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.241456 (+ 498us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.241618 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:05:45.241778 17792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ecebe6c79b4819962b69f19407772e" candidate_uuid: "490e9aff3a894562b4a7f04fccac7bee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29a376c9305445429d6fce32b89e850c" is_pre_election: true
I20260805 23:05:45.242398 17792 raft_consensus.cc:2454] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490e9aff3a894562b4a7f04fccac7bee in term 0.
I20260805 23:05:45.242976 17979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ecebe6c79b4819962b69f19407772e" candidate_uuid: "490e9aff3a894562b4a7f04fccac7bee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a881aa3f1bb54bf0acead575a708a557" is_pre_election: true
I20260805 23:05:45.243343 18073 leader_election.cc:302] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29a376c9305445429d6fce32b89e850c, 490e9aff3a894562b4a7f04fccac7bee; no voters:
I20260805 23:05:45.243454 17979 raft_consensus.cc:2454] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 490e9aff3a894562b4a7f04fccac7bee in term 0.
I20260805 23:05:45.243793 18259 raft_consensus.cc:2781] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260805 23:05:45.243954 18259 raft_consensus.cc:482] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260805 23:05:45.244068 18259 raft_consensus.cc:3037] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:45.246356 18259 raft_consensus.cc:504] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.247036 18259 leader_election.cc:288] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [CANDIDATE]: Term 1 election: Requested vote from peers a881aa3f1bb54bf0acead575a708a557 (127.22.45.66:34635), 29a376c9305445429d6fce32b89e850c (127.22.45.65:39493)
I20260805 23:05:45.247597 17792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ecebe6c79b4819962b69f19407772e" candidate_uuid: "490e9aff3a894562b4a7f04fccac7bee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29a376c9305445429d6fce32b89e850c"
I20260805 23:05:45.247679 17979 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ecebe6c79b4819962b69f19407772e" candidate_uuid: "490e9aff3a894562b4a7f04fccac7bee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a881aa3f1bb54bf0acead575a708a557"
I20260805 23:05:45.247805 17792 raft_consensus.cc:3037] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:45.247951 17979 raft_consensus.cc:3037] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:45.250236 17792 raft_consensus.cc:2454] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490e9aff3a894562b4a7f04fccac7bee in term 1.
I20260805 23:05:45.250967 18073 leader_election.cc:302] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29a376c9305445429d6fce32b89e850c, 490e9aff3a894562b4a7f04fccac7bee; no voters:
I20260805 23:05:45.251323 18259 raft_consensus.cc:2781] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:45.251842 17979 raft_consensus.cc:2454] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 490e9aff3a894562b4a7f04fccac7bee in term 1.
I20260805 23:05:45.251845 18259 raft_consensus.cc:686] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 1 LEADER]: Becoming Leader. State: Replica: 490e9aff3a894562b4a7f04fccac7bee, State: Running, Role: LEADER
I20260805 23:05:45.252444 18259 consensus_queue.cc:237] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } }
I20260805 23:05:45.257615 17590 catalog_manager.cc:5495] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee reported cstate change: term changed from 0 to 1, leader changed from <none> to 490e9aff3a894562b4a7f04fccac7bee (127.22.45.67). New cstate: current_term: 1 leader_uuid: "490e9aff3a894562b4a7f04fccac7bee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "490e9aff3a894562b4a7f04fccac7bee" member_type: VOTER last_known_addr { host: "127.22.45.67" port: 45011 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 } health_report { overall_health: UNKNOWN } } }
W20260805 23:05:45.299862 18222 tablet.cc:2369] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:45.300117 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.294030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37646 (local address 127.22.45.67:45011)
0805 23:05:45.294280 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.294287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.294387 (+ 100us) server_negotiation.cc:407] Connection header received
0805 23:05:45.294657 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.294662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.294758 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.294939 (+ 181us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:05:45.295343 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.296087 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.297612 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.298059 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.298179 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.298766 (+ 587us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:05:45.299381 (+ 615us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:05:45.299520 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.299623 (+ 103us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.299721 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260805 23:05:45.305150 18048 tablet.cc:2369] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:45.308935 17979 raft_consensus.cc:1261] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 1 FOLLOWER]: Refusing update from remote peer 490e9aff3a894562b4a7f04fccac7bee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:45.308934 17792 raft_consensus.cc:1261] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 1 FOLLOWER]: Refusing update from remote peer 490e9aff3a894562b4a7f04fccac7bee: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:05:45.309899 18261 consensus_queue.cc:1035] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [LEADER]: Connected to new peer: Peer: permanent_uuid: "29a376c9305445429d6fce32b89e850c" member_type: VOTER last_known_addr { host: "127.22.45.65" port: 39493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:05:45.310313 18259 consensus_queue.cc:1035] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [LEADER]: Connected to new peer: Peer: permanent_uuid: "a881aa3f1bb54bf0acead575a708a557" member_type: VOTER last_known_addr { host: "127.22.45.66" port: 34635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260805 23:05:45.320551 17853 tablet.cc:2369] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:05:45.322798 18264 mvcc.cc:205] Tried to move back new op lower bound from 7315337811175358464 to 7315337810958405632. Current Snapshot: MvccSnapshot[applied={T|T < 7315337811175358464}]
I20260805 23:05:45.339350 17590 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:45.339651 17590 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42414:
table { table_name: "test-table" } modify_external_catalogs: true
I20260805 23:05:45.343850 17590 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5a603aebf5414e9c9c6e3795c73afbce: Sending DeleteTablet for 3 replicas of tablet 03ecebe6c79b4819962b69f19407772e
I20260805 23:05:45.345425 17762 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ecebe6c79b4819962b69f19407772e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:45 UTC) from {username='slave'} at 127.0.0.1:33422
I20260805 23:05:45.345625 18136 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ecebe6c79b4819962b69f19407772e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:45 UTC) from {username='slave'} at 127.0.0.1:37638
I20260805 23:05:45.346318 17948 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ecebe6c79b4819962b69f19407772e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-05 23:05:45 UTC) from {username='slave'} at 127.0.0.1:52890
I20260805 23:05:45.347330 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 17671
I20260805 23:05:45.367992 18280 tablet_replica.cc:330] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: stopping tablet replica
I20260805 23:05:45.368466 18280 raft_consensus.cc:2229] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 1 LEADER]: Raft consensus shutting down.
I20260805 23:05:45.369139 18280 raft_consensus.cc:2258] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:45.369969 18282 tablet_replica.cc:330] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: stopping tablet replica
I20260805 23:05:45.370373 18282 raft_consensus.cc:2229] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:45.371604 18279 tablet_replica.cc:330] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c: stopping tablet replica
I20260805 23:05:45.372114 18279 raft_consensus.cc:2229] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260805 23:05:45.372668 18279 raft_consensus.cc:2258] T 03ecebe6c79b4819962b69f19407772e P 29a376c9305445429d6fce32b89e850c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:45.374004 18239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.348837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33426 (local address 127.22.45.65:39493)
0805 23:05:45.349047 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.349054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.359721 (+ 10667us) server_negotiation.cc:407] Connection header received
0805 23:05:45.360338 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.360346 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.360508 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.360593 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:45.361383 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.362738 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.364918 (+ 2180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.365702 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.365825 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.372010 (+ 6185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:45.372026 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:45.372056 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:45.372936 (+ 880us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:45.373013 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:45.373059 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:45.373242 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.373479 (+ 237us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.373642 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:05:45.374825 17845 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:45.374776 18280 ts_tablet_manager.cc:1905] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:45.378549 18282 raft_consensus.cc:2258] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260805 23:05:45.385389 18282 ts_tablet_manager.cc:1905] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260805 23:05:45.385598 18280 ts_tablet_manager.cc:1918] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:45.385823 18280 log.cc:1196] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-2/wal/wals/03ecebe6c79b4819962b69f19407772e
I20260805 23:05:45.386500 18280 ts_tablet_manager.cc:1939] T 03ecebe6c79b4819962b69f19407772e P 490e9aff3a894562b4a7f04fccac7bee: Deleting consensus metadata
I20260805 23:05:45.388782 17572 catalog_manager.cc:4841] TS 490e9aff3a894562b4a7f04fccac7bee (127.22.45.67:45011): tablet 03ecebe6c79b4819962b69f19407772e (table test-table [id=88472a6743894d47b8eeea886aefc879]) successfully deleted
I20260805 23:05:45.393265 18282 ts_tablet_manager.cc:1918] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260805 23:05:45.393498 18282 log.cc:1196] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Deleting WAL directory at /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1785970804553337-22709-0/minicluster-data/ts-1/wal/wals/03ecebe6c79b4819962b69f19407772e
I20260805 23:05:45.394109 18282 ts_tablet_manager.cc:1939] T 03ecebe6c79b4819962b69f19407772e P a881aa3f1bb54bf0acead575a708a557: Deleting consensus metadata
I20260805 23:05:45.396410 17572 catalog_manager.cc:4841] TS a881aa3f1bb54bf0acead575a708a557 (127.22.45.66:34635): tablet 03ecebe6c79b4819962b69f19407772e (table test-table [id=88472a6743894d47b8eeea886aefc879]) successfully deleted
I20260805 23:05:45.469604 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 17671
I20260805 23:05:45.491816 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 17858
W20260805 23:05:45.491941 17574 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.45.65:39493 (error 108)
I20260805 23:05:45.494186 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.493626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33442)
0805 23:05:45.493910 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.494027 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260805 23:05:45.494416 17574 catalog_manager.cc:4584] TS 29a376c9305445429d6fce32b89e850c (127.22.45.65:39493): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03ecebe6c79b4819962b69f19407772e: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
I20260805 23:05:45.500618 18238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.492933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52894 (local address 127.22.45.66:34635)
0805 23:05:45.493183 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.493189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.493292 (+ 103us) server_negotiation.cc:407] Connection header received
0805 23:05:45.493513 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.493519 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.493634 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.493735 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:45.494429 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.495621 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.496914 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.497581 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.497718 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.498789 (+ 1071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:45.498800 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:45.498821 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:45.499717 (+ 896us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:45.499800 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:45.499828 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:45.499952 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.500109 (+ 157us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.500232 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260805 23:05:45.501402 18037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:45.548353 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.547751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33450)
0805 23:05:45.548013 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.548138 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260805 23:05:45.549602 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.549181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33466)
0805 23:05:45.549344 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.549439 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260805 23:05:45.592501 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 17858
I20260805 23:05:45.610700 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.610115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33468)
0805 23:05:45.610365 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.610478 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260805 23:05:45.612057 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.611592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33480)
0805 23:05:45.611791 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.611892 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260805 23:05:45.614041 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18051
I20260805 23:05:45.621783 18242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.614742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37650 (local address 127.22.45.67:45011)
0805 23:05:45.614955 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:45.614961 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:45.615044 (+ 83us) server_negotiation.cc:407] Connection header received
0805 23:05:45.615220 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:45.615225 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:45.615328 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:45.615432 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:45.615834 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.616632 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.617897 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:45.618448 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:45.618567 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:45.620103 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:45.620114 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:45.620133 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:45.620933 (+ 800us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:45.621006 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:45.621040 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:45.621161 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:45.621340 (+ 179us) server_negotiation.cc:299] Negotiation successful
0805 23:05:45.621422 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:05:45.622536 18215 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:45.692833 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.692237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33496)
0805 23:05:45.692461 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.692591 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260805 23:05:45.694147 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.693607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33498)
0805 23:05:45.693868 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.693968 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260805 23:05:45.746454 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 18051
I20260805 23:05:45.774176 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 17549
I20260805 23:05:45.775557 17629 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:45.887734 18240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:45.887039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.65:39493 (local address 127.0.0.1:33500)
0805 23:05:45.887370 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0805 23:05:45.887518 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.65:39493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180}
I20260805 23:05:45.887876 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 17549
2026-08-05T23:05:45Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3017 ms)
[----------] 6 tests from EncryptionPolicyTest (23433 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:46 dist-test-slave-1vmg krb5kdc[18297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:46 dist-test-slave-1vmg krb5kdc[18297](info): set up 2 sockets
Aug 05 23:05:46 dist-test-slave-1vmg krb5kdc[18297](info): commencing operation
krb5kdc: starting...
W20260805 23:05:47.120947 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.181s user 0.002s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:47 dist-test-slave-1vmg krb5kdc[18297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:05:47.442642 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45083
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:47.808612 18320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:47.808974 18320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:47.809073 18320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:47.816716 18320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:47.816869 18320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:47.816918 18320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:47.816985 18320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:47.817030 18320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:47.827668 18320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45083
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:47.829129 18320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:47.830518 18320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:47.843122 18326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:47.843050 18331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:47.843079 18327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:47.844568 18320 server_base.cc:1034] running on GCE node
I20260805 23:05:47.845451 18320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:47.847119 18320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:47.848342 18320 hybrid_clock.cc:648] HybridClock initialized: now 1785971147848292 us; error 53 us; skew 500 ppm
I20260805 23:05:47.848734 18320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:47 dist-test-slave-1vmg krb5kdc[18297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971147, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:47.852164 18320 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:05:47.853863 18320 webserver.cc:460] Webserver started at http://127.0.0.1:41107/ using document root <none> and password file <none>
I20260805 23:05:47.854656 18320 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:47.854790 18320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:47.855176 18320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:47.858635 18320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "cb7047be9ec2493bb25c49f857a57408"
format_stamp: "Formatted at 2026-08-05 23:05:47 on dist-test-slave-1vmg"
server_key: "adb18c53e8baf710248ce29dfc810ac1"
server_key_iv: "845be94083d8d1d399860a789b5ea5bd"
server_key_version: "encryptionkey@0"
I20260805 23:05:47.859609 18320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "cb7047be9ec2493bb25c49f857a57408"
format_stamp: "Formatted at 2026-08-05 23:05:47 on dist-test-slave-1vmg"
server_key: "adb18c53e8baf710248ce29dfc810ac1"
server_key_iv: "845be94083d8d1d399860a789b5ea5bd"
server_key_version: "encryptionkey@0"
I20260805 23:05:47.865866 18320 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:05:47.870231 18340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:47.871917 18320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:47.872138 18320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "cb7047be9ec2493bb25c49f857a57408"
format_stamp: "Formatted at 2026-08-05 23:05:47 on dist-test-slave-1vmg"
server_key: "adb18c53e8baf710248ce29dfc810ac1"
server_key_iv: "845be94083d8d1d399860a789b5ea5bd"
server_key_version: "encryptionkey@0"
I20260805 23:05:47.872380 18320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:47.897832 18320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:47.902649 18320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:47.903002 18320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:47.922703 18320 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45083
I20260805 23:05:47.922745 18408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45083 every 8 connection(s)
I20260805 23:05:47.924321 18320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:47.926002 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 18320
I20260805 23:05:47.926216 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:47.926946 22709 external_mini_cluster.cc:1428] Setting key 879ba679c290dd3a0ea6c8b7d6ab20eb
I20260805 23:05:47.928982 18409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:05:47 dist-test-slave-1vmg krb5kdc[18297](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 23:05:47.944038 18409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408: Bootstrap starting.
I20260805 23:05:47.948323 18409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:47.949790 18409 log.cc:824] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:47.953445 18409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408: No bootstrap required, opened a new log
I20260805 23:05:47.954561 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:47.929127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42027 (local address 127.0.0.1:45083)
0805 23:05:47.930007 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:47.930025 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:47.930100 (+ 75us) server_negotiation.cc:407] Connection header received
0805 23:05:47.932486 (+ 2386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:47.932525 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:47.933231 (+ 706us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:47.933789 (+ 558us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:47.935707 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:47.937866 (+ 2159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:47.939425 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:47.940549 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:47.940758 (+ 209us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:47.945137 (+ 4379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:47.945150 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:47.945171 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:47.945252 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:47.949300 (+ 4048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:47.950289 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:47.950299 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:47.950309 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:47.950577 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:47.951116 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:47.951121 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:47.951124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:47.951883 (+ 759us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:47.952242 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:47.952719 (+ 477us) server_negotiation.cc:299] Negotiation successful
0805 23:05:47.953094 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":339,"threads_started":1}
I20260805 23:05:47.959560 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:05:47.963635 18409 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7047be9ec2493bb25c49f857a57408" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260805 23:05:47.964294 18409 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:47.964421 18409 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb7047be9ec2493bb25c49f857a57408, State: Initialized, Role: FOLLOWER
I20260805 23:05:47.965260 18409 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7047be9ec2493bb25c49f857a57408" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260805 23:05:47.965548 18409 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:47.965710 18409 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:47.965909 18409 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:47.968408 18409 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7047be9ec2493bb25c49f857a57408" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260805 23:05:47.969170 18409 leader_election.cc:302] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb7047be9ec2493bb25c49f857a57408; no voters:
I20260805 23:05:47.970240 18409 leader_election.cc:288] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:47.970410 18422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:47.971649 18422 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [term 1 LEADER]: Becoming Leader. State: Replica: cb7047be9ec2493bb25c49f857a57408, State: Running, Role: LEADER
I20260805 23:05:47.972345 18422 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7047be9ec2493bb25c49f857a57408" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } }
I20260805 23:05:47.973058 18409 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:47.975934 18423 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb7047be9ec2493bb25c49f857a57408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7047be9ec2493bb25c49f857a57408" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } } }
I20260805 23:05:47.976686 18423 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:47.976250 18424 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb7047be9ec2493bb25c49f857a57408. Latest consensus state: current_term: 1 leader_uuid: "cb7047be9ec2493bb25c49f857a57408" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb7047be9ec2493bb25c49f857a57408" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45083 } } }
I20260805 23:05:47.977744 18424 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:47.987349 18412 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:47.965742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47365 (local address 127.0.0.1:45083)
0805 23:05:47.965977 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:47.965985 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:47.966550 (+ 565us) server_negotiation.cc:407] Connection header received
0805 23:05:47.966749 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:47.966753 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:47.966829 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:47.966956 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:47.968689 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:47.970217 (+ 1528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:47.972194 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:47.972840 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:47.972969 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:47.977592 (+ 4623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:47.977601 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:47.977606 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:47.977662 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:47.982331 (+ 4669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:47.983875 (+ 1544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:47.983883 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:47.983888 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:47.984166 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:47.984908 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:47.984914 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:47.984918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:47.985421 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:47.985800 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:47.986640 (+ 840us) server_negotiation.cc:299] Negotiation successful
0805 23:05:47.986957 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260805 23:05:47.988961 18427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:47.993930 18427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:48.004276 18427 catalog_manager.cc:1347] Generated new cluster ID: c42c79747ca24da8ac8eb1ad45883686
I20260805 23:05:48.004419 18427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:48.029959 18427 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:48.032106 18427 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:48.052484 18427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb7047be9ec2493bb25c49f857a57408: Generated new TSK 0
I20260805 23:05:48.053853 18427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:48.069530 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18320
I20260805 23:05:48.071681 18403 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:48.168107 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 18320
W20260805 23:05:48.189797 18292 connection.cc:535] client connection to 127.0.0.1:45083 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45083): Connection reset by peer (error 104)
2026-08-05T23:05:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2270 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:48 dist-test-slave-1vmg krb5kdc[18454](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:48 dist-test-slave-1vmg krb5kdc[18454](info): set up 2 sockets
Aug 05 23:05:48 dist-test-slave-1vmg krb5kdc[18454](info): commencing operation
krb5kdc: starting...
W20260805 23:05:49.392009 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.182s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:49 dist-test-slave-1vmg krb5kdc[18454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:05:49.712404 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45561
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45561
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:50.090641 18471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:50.091076 18471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:50.091204 18471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:50.099002 18471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:50.099167 18471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:50.099225 18471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:50.099288 18471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:50.099344 18471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:50.110420 18471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45561
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:50.111958 18471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:50.113526 18471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:50.129352 18485 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:50.129276 18489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:50.129305 18487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:50.130496 18471 server_base.cc:1034] running on GCE node
I20260805 23:05:50.131731 18471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:50.134063 18471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:50.135347 18471 hybrid_clock.cc:648] HybridClock initialized: now 1785971150135278 us; error 70 us; skew 500 ppm
I20260805 23:05:50.135814 18471 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:50 dist-test-slave-1vmg krb5kdc[18454](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971150, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:50.139854 18471 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:05:50.141991 18471 webserver.cc:460] Webserver started at http://127.0.0.1:38877/ using document root <none> and password file <none>
I20260805 23:05:50.143079 18471 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:50.143224 18471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:50.143573 18471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:50.147830 18471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "a198974f51184645bcfe9ac0e181ea1c"
format_stamp: "Formatted at 2026-08-05 23:05:50 on dist-test-slave-1vmg"
server_key: "9aff5da3a9ec2f64f91b6d0c5757ab08"
server_key_iv: "ae65132a5a9ceab9096399c662dd333d"
server_key_version: "encryptionkey@0"
I20260805 23:05:50.148885 18471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "a198974f51184645bcfe9ac0e181ea1c"
format_stamp: "Formatted at 2026-08-05 23:05:50 on dist-test-slave-1vmg"
server_key: "9aff5da3a9ec2f64f91b6d0c5757ab08"
server_key_iv: "ae65132a5a9ceab9096399c662dd333d"
server_key_version: "encryptionkey@0"
I20260805 23:05:50.155457 18471 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260805 23:05:50.159833 18499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:50.161523 18471 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260805 23:05:50.161718 18471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "a198974f51184645bcfe9ac0e181ea1c"
format_stamp: "Formatted at 2026-08-05 23:05:50 on dist-test-slave-1vmg"
server_key: "9aff5da3a9ec2f64f91b6d0c5757ab08"
server_key_iv: "ae65132a5a9ceab9096399c662dd333d"
server_key_version: "encryptionkey@0"
I20260805 23:05:50.161931 18471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:50.174893 18471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:50.180653 18471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:50.180967 18471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:50.201063 18471 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45561
I20260805 23:05:50.201085 18563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45561 every 8 connection(s)
I20260805 23:05:50.202646 18471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:50.205687 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 18471
I20260805 23:05:50.205871 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:50.206341 22709 external_mini_cluster.cc:1428] Setting key b0d5778983c6054ed33147267d7d8122
I20260805 23:05:50.207214 18564 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:50.221936 18568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:50.208294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60291 (local address 127.0.0.1:45561)
0805 23:05:50.209147 (+ 853us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:50.209161 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:50.209216 (+ 55us) server_negotiation.cc:407] Connection header received
0805 23:05:50.210907 (+ 1691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:50.210974 (+ 67us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:50.211494 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:50.211907 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:50.212644 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:50.214081 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:50.216122 (+ 2041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:50.217341 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:50.217501 (+ 160us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:50.219129 (+ 1628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:50.219139 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:50.219163 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:50.219891 (+ 728us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:50.219998 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:50.220033 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:50.220202 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:50.220574 (+ 372us) server_negotiation.cc:299] Negotiation successful
0805 23:05:50.220801 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":369,"threads_started":1}
I20260805 23:05:50.222426 18564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c: Bootstrap starting.
I20260805 23:05:50.226104 18564 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:50.226315 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:05:50.227582 18564 log.cc:824] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:50.231745 18564 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c: No bootstrap required, opened a new log
I20260805 23:05:50.239682 18568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:50.231963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39355 (local address 127.0.0.1:45561)
0805 23:05:50.232165 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:50.232172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:50.232605 (+ 433us) server_negotiation.cc:407] Connection header received
0805 23:05:50.232789 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:50.232795 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:50.232877 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:50.232994 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:50.233638 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:50.235008 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:50.236482 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:50.237233 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:50.237387 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:50.238693 (+ 1306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:50.238700 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:50.238705 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:50.238744 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:50.238820 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:50.238843 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:50.239011 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:50.239241 (+ 230us) server_negotiation.cc:299] Negotiation successful
0805 23:05:50.239306 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 23:05:50.242048 18564 raft_consensus.cc:348] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a198974f51184645bcfe9ac0e181ea1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45561 } }
I20260805 23:05:50.242504 18564 raft_consensus.cc:374] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:50.242587 18564 raft_consensus.cc:729] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a198974f51184645bcfe9ac0e181ea1c, State: Initialized, Role: FOLLOWER
I20260805 23:05:50.243270 18564 consensus_queue.cc:260] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a198974f51184645bcfe9ac0e181ea1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45561 } }
I20260805 23:05:50.243513 18564 raft_consensus.cc:388] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:50.243636 18564 raft_consensus.cc:482] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:50.243774 18564 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:50.246299 18564 raft_consensus.cc:504] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a198974f51184645bcfe9ac0e181ea1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45561 } }
I20260805 23:05:50.247056 18564 leader_election.cc:302] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a198974f51184645bcfe9ac0e181ea1c; no voters:
I20260805 23:05:50.247848 18564 leader_election.cc:288] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:50.247989 18579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:50.248764 18579 raft_consensus.cc:686] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [term 1 LEADER]: Becoming Leader. State: Replica: a198974f51184645bcfe9ac0e181ea1c, State: Running, Role: LEADER
I20260805 23:05:50.249418 18579 consensus_queue.cc:237] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a198974f51184645bcfe9ac0e181ea1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45561 } }
I20260805 23:05:50.250193 18564 sys_catalog.cc:564] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:50.252504 18580 sys_catalog.cc:455] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a198974f51184645bcfe9ac0e181ea1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a198974f51184645bcfe9ac0e181ea1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45561 } } }
I20260805 23:05:50.252880 18580 sys_catalog.cc:458] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:50.252401 18581 sys_catalog.cc:455] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a198974f51184645bcfe9ac0e181ea1c. Latest consensus state: current_term: 1 leader_uuid: "a198974f51184645bcfe9ac0e181ea1c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a198974f51184645bcfe9ac0e181ea1c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45561 } } }
I20260805 23:05:50.253657 18581 sys_catalog.cc:458] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:50.256040 18588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:50.262081 18588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:50.272393 18588 catalog_manager.cc:1347] Generated new cluster ID: 3a1e86bff6354bd39e6013d21b9bb730
I20260805 23:05:50.272547 18588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:50.292253 18588 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:50.293810 18588 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:50.300606 18588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a198974f51184645bcfe9ac0e181ea1c: Generated new TSK 0
I20260805 23:05:50.301592 18588 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:50.316625 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18471
W20260805 23:05:50.318141 18559 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60291
W20260805 23:05:50.319236 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18471: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:05:50.319439 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 18471
W20260805 23:05:50.343091 18451 connection.cc:535] client connection to 127.0.0.1:45561 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45561): Connection reset by peer (error 104)
2026-08-05T23:05:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2153 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:50 dist-test-slave-1vmg krb5kdc[18607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:50 dist-test-slave-1vmg krb5kdc[18607](info): set up 2 sockets
Aug 05 23:05:50 dist-test-slave-1vmg krb5kdc[18607](info): commencing operation
krb5kdc: starting...
W20260805 23:05:51.536669 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.002s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:51 dist-test-slave-1vmg krb5kdc[18607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:05:51.863005 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38983
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45453
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:52.245504 18626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:52.245898 18626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:52.246055 18626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:52.254073 18626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:52.254241 18626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:52.254326 18626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:52.254421 18626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:52.254482 18626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:52.265313 18626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45453
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38983
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:52.266811 18626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:52.268308 18626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:52.280730 18635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:52.280643 18632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:52.280695 18637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:52.281922 18626 server_base.cc:1034] running on GCE node
I20260805 23:05:52.282686 18626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:52.284219 18626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:52.285422 18626 hybrid_clock.cc:648] HybridClock initialized: now 1785971152285373 us; error 38 us; skew 500 ppm
I20260805 23:05:52.285777 18626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:52 dist-test-slave-1vmg krb5kdc[18607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971152, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:52.293067 18626 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:05:52.294786 18626 webserver.cc:460] Webserver started at http://127.0.0.1:43195/ using document root <none> and password file <none>
I20260805 23:05:52.295583 18626 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:52.295727 18626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:52.296052 18626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:52.299391 18626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "dfe80b1955be428ebc00607a2f2666d9"
format_stamp: "Formatted at 2026-08-05 23:05:52 on dist-test-slave-1vmg"
server_key: "e3d6b1d8f24b778f0338f3ee7294b199"
server_key_iv: "96cf26b97d4da94972f1a8e1bb58e6a0"
server_key_version: "encryptionkey@0"
I20260805 23:05:52.300269 18626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "dfe80b1955be428ebc00607a2f2666d9"
format_stamp: "Formatted at 2026-08-05 23:05:52 on dist-test-slave-1vmg"
server_key: "e3d6b1d8f24b778f0338f3ee7294b199"
server_key_iv: "96cf26b97d4da94972f1a8e1bb58e6a0"
server_key_version: "encryptionkey@0"
I20260805 23:05:52.306185 18626 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260805 23:05:52.310424 18647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:52.312134 18626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:52.312353 18626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "dfe80b1955be428ebc00607a2f2666d9"
format_stamp: "Formatted at 2026-08-05 23:05:52 on dist-test-slave-1vmg"
server_key: "e3d6b1d8f24b778f0338f3ee7294b199"
server_key_iv: "96cf26b97d4da94972f1a8e1bb58e6a0"
server_key_version: "encryptionkey@0"
I20260805 23:05:52.312590 18626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:52.319567 18626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:52.324306 18626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:52.324649 18626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:52.344617 18626 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38983
I20260805 23:05:52.344656 18726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38983 every 8 connection(s)
I20260805 23:05:52.346282 18626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:52.348526 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 18626
I20260805 23:05:52.348745 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:52.349359 22709 external_mini_cluster.cc:1428] Setting key c9fc9bf2d8615da52912d9c458be9bb3
I20260805 23:05:52.351488 18727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:52.358376 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:52.351581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55839 (local address 127.0.0.1:38983)
0805 23:05:52.352530 (+ 949us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:52.352543 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:52.352602 (+ 59us) server_negotiation.cc:407] Connection header received
0805 23:05:52.354351 (+ 1749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:52.354376 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:52.354801 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:52.355315 (+ 514us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:52.356516 (+ 1201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:52.356523 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:52.356538 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:52.356555 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:52.356651 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:52.356677 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:52.356930 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:52.357090 (+ 160us) server_negotiation.cc:299] Negotiation successful
0805 23:05:52.357311 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":410,"threads_started":1}
I20260805 23:05:52.362591 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:05:52.365137 18727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9: Bootstrap starting.
I20260805 23:05:52.369230 18727 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:52.370049 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:52.367373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57451 (local address 127.0.0.1:38983)
0805 23:05:52.367567 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:52.367574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:52.367964 (+ 390us) server_negotiation.cc:407] Connection header received
0805 23:05:52.368156 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:52.368163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:52.368225 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:52.368317 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:52.369340 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:52.369346 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:52.369349 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:52.369367 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:52.369425 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:52.369447 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:52.369563 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:52.369690 (+ 127us) server_negotiation.cc:299] Negotiation successful
0805 23:05:52.369761 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 23:05:52.370653 18727 log.cc:824] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:52.373904 18727 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9: No bootstrap required, opened a new log
I20260805 23:05:52.382002 18727 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfe80b1955be428ebc00607a2f2666d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38983 } }
I20260805 23:05:52.382493 18727 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:52.382596 18727 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfe80b1955be428ebc00607a2f2666d9, State: Initialized, Role: FOLLOWER
I20260805 23:05:52.383279 18727 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfe80b1955be428ebc00607a2f2666d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38983 } }
I20260805 23:05:52.383538 18727 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:52.383683 18727 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:52.383859 18727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:52.386230 18727 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfe80b1955be428ebc00607a2f2666d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38983 } }
I20260805 23:05:52.386822 18727 leader_election.cc:302] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfe80b1955be428ebc00607a2f2666d9; no voters:
I20260805 23:05:52.387553 18727 leader_election.cc:288] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:52.387694 18742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:52.388345 18742 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [term 1 LEADER]: Becoming Leader. State: Replica: dfe80b1955be428ebc00607a2f2666d9, State: Running, Role: LEADER
I20260805 23:05:52.388896 18742 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfe80b1955be428ebc00607a2f2666d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38983 } }
I20260805 23:05:52.389658 18727 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:52.391889 18744 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfe80b1955be428ebc00607a2f2666d9. Latest consensus state: current_term: 1 leader_uuid: "dfe80b1955be428ebc00607a2f2666d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfe80b1955be428ebc00607a2f2666d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38983 } } }
I20260805 23:05:52.391862 18743 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfe80b1955be428ebc00607a2f2666d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfe80b1955be428ebc00607a2f2666d9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38983 } } }
I20260805 23:05:52.392367 18744 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:52.392367 18743 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:52.394538 18751 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:52.399843 18751 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:52.410658 18751 catalog_manager.cc:1347] Generated new cluster ID: febe75be86a54d13b7dde1ae0e66ae7a
I20260805 23:05:52.410841 18751 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:52.430761 18751 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:52.431355 18751 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:52.449491 18751 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfe80b1955be428ebc00607a2f2666d9: Generated new TSK 0
I20260805 23:05:52.450531 18751 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:52.470052 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18626
W20260805 23:05:52.471386 18720 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:55839
W20260805 23:05:52.472193 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18626: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:05:52.472343 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 18626
2026-08-05T23:05:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2153 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:52 dist-test-slave-1vmg krb5kdc[18775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:52 dist-test-slave-1vmg krb5kdc[18775](info): set up 2 sockets
Aug 05 23:05:52 dist-test-slave-1vmg krb5kdc[18775](info): commencing operation
krb5kdc: starting...
W20260805 23:05:53.683391 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.167s user 0.003s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:53 dist-test-slave-1vmg krb5kdc[18775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:05:54.012459 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36319
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36319
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:54.382843 18792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:54.383206 18792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:54.383311 18792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:54.390785 18792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:54.390952 18792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:54.391027 18792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:54.391095 18792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:54.391149 18792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:54.401665 18792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:54.403152 18792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:54.404577 18792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:54.417186 18798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:54.417227 18800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:54.417263 18797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:54.418155 18792 server_base.cc:1034] running on GCE node
I20260805 23:05:54.419104 18792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:54.420713 18792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:54.421938 18792 hybrid_clock.cc:648] HybridClock initialized: now 1785971154421890 us; error 38 us; skew 500 ppm
I20260805 23:05:54.422327 18792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:54 dist-test-slave-1vmg krb5kdc[18775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971154, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:54.425823 18792 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:05:54.427721 18792 webserver.cc:460] Webserver started at http://127.0.0.1:39817/ using document root <none> and password file <none>
I20260805 23:05:54.428552 18792 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:54.428705 18792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:54.429068 18792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:54.432572 18792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "8cc71227c84945a6bb0b25e17ff33d6d"
format_stamp: "Formatted at 2026-08-05 23:05:54 on dist-test-slave-1vmg"
server_key: "79227fe0c385a23027ad58a34f51756e"
server_key_iv: "3dc711f784a75d1bd4de8fa8117c742c"
server_key_version: "encryptionkey@0"
I20260805 23:05:54.433451 18792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "8cc71227c84945a6bb0b25e17ff33d6d"
format_stamp: "Formatted at 2026-08-05 23:05:54 on dist-test-slave-1vmg"
server_key: "79227fe0c385a23027ad58a34f51756e"
server_key_iv: "3dc711f784a75d1bd4de8fa8117c742c"
server_key_version: "encryptionkey@0"
I20260805 23:05:54.439471 18792 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260805 23:05:54.443540 18809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:54.445107 18792 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:05:54.445329 18792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "8cc71227c84945a6bb0b25e17ff33d6d"
format_stamp: "Formatted at 2026-08-05 23:05:54 on dist-test-slave-1vmg"
server_key: "79227fe0c385a23027ad58a34f51756e"
server_key_iv: "3dc711f784a75d1bd4de8fa8117c742c"
server_key_version: "encryptionkey@0"
I20260805 23:05:54.445560 18792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:54.465750 18792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:54.470587 18792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:54.470968 18792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:54.490492 18792 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36319
I20260805 23:05:54.490515 18892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36319 every 8 connection(s)
I20260805 23:05:54.492084 18792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:54.495930 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 18792
I20260805 23:05:54.496161 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:54.496443 18894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:54.496742 22709 external_mini_cluster.cc:1428] Setting key 530855cae9af881a0d877289657b5f44
I20260805 23:05:54.512297 18894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d: Bootstrap starting.
Aug 05 23:05:54 dist-test-slave-1vmg krb5kdc[18775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971153, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 23:05:54.516649 18894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:54.518258 18894 log.cc:824] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:54.522519 18894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d: No bootstrap required, opened a new log
I20260805 23:05:54.524075 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:54.498632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45415 (local address 127.0.0.1:36319)
0805 23:05:54.499519 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:54.499534 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:54.499594 (+ 60us) server_negotiation.cc:407] Connection header received
0805 23:05:54.501844 (+ 2250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:54.501877 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:54.502515 (+ 638us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:54.503066 (+ 551us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:54.504545 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:54.506583 (+ 2038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:54.508023 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:54.509216 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:54.509442 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:54.514206 (+ 4764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:54.514219 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:54.514242 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:54.514312 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:54.518641 (+ 4329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:54.519771 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:54.519781 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:54.519792 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:54.520012 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:54.520459 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:54.520464 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:54.520467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:54.521276 (+ 809us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:54.521627 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:54.521988 (+ 361us) server_negotiation.cc:299] Negotiation successful
0805 23:05:54.522503 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":630,"thread_start_us":374,"threads_started":1}
I20260805 23:05:54.528566 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:05:54.532917 18894 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36319 } }
I20260805 23:05:54.533510 18894 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:54.533645 18894 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8cc71227c84945a6bb0b25e17ff33d6d, State: Initialized, Role: FOLLOWER
I20260805 23:05:54.534490 18894 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36319 } }
I20260805 23:05:54.534835 18894 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:54.535017 18894 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:54.535211 18894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:54.537667 18894 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36319 } }
I20260805 23:05:54.538261 18894 leader_election.cc:302] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8cc71227c84945a6bb0b25e17ff33d6d; no voters:
I20260805 23:05:54.539017 18894 leader_election.cc:288] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:54.539140 18907 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:54.541808 18894 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:54.543665 18907 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [term 1 LEADER]: Becoming Leader. State: Replica: 8cc71227c84945a6bb0b25e17ff33d6d, State: Running, Role: LEADER
I20260805 23:05:54.544577 18907 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36319 } }
I20260805 23:05:54.547930 18909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8cc71227c84945a6bb0b25e17ff33d6d. Latest consensus state: current_term: 1 leader_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36319 } } }
I20260805 23:05:54.548418 18909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:54.547942 18908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8cc71227c84945a6bb0b25e17ff33d6d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36319 } } }
I20260805 23:05:54.548964 18908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:54.552495 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:54.534288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60389 (local address 127.0.0.1:36319)
0805 23:05:54.534492 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:54.534499 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:54.534863 (+ 364us) server_negotiation.cc:407] Connection header received
0805 23:05:54.535108 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:54.535114 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:54.535204 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:54.535297 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:54.536966 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:54.537703 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:54.539223 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:54.539989 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:54.540797 (+ 808us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:54.542826 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:54.542832 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:54.542835 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:05:54.542870 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:54.547240 (+ 4370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:54.548440 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:54.548450 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:54.548455 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:54.548641 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:05:54.549190 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:05:54.549195 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:05:54.549199 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:05:54.549908 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:54.551619 (+ 1711us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:54.551794 (+ 175us) server_negotiation.cc:299] Negotiation successful
0805 23:05:54.552070 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 23:05:54.554564 18920 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:54.559219 18920 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:54.567832 18920 catalog_manager.cc:1347] Generated new cluster ID: 84918ca19b1a45c98d04af3e9e922158
I20260805 23:05:54.567966 18920 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:54.605597 18920 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:54.607923 18920 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:54.621035 18920 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8cc71227c84945a6bb0b25e17ff33d6d: Generated new TSK 0
I20260805 23:05:54.622316 18920 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:54.633651 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18792
I20260805 23:05:54.635151 18886 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:05:54.732885 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 18792
2026-08-05T23:05:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2259 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:54 dist-test-slave-1vmg krb5kdc[18934](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:54 dist-test-slave-1vmg krb5kdc[18934](info): set up 2 sockets
Aug 05 23:05:54 dist-test-slave-1vmg krb5kdc[18934](info): commencing operation
krb5kdc: starting...
W20260805 23:05:55.949175 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.173s user 0.002s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:56 dist-test-slave-1vmg krb5kdc[18934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:05:56.281411 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46299
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36781
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:56.644556 18950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:56.644944 18950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:56.645079 18950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:56.652940 18950 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:56.653087 18950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:56.653153 18950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:56.653262 18950 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:56.653319 18950 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:56.664045 18950 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36781
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:56.665493 18950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:56.666877 18950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:56.679757 18959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:56.679677 18962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:56.679708 18960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:56.681033 18950 server_base.cc:1034] running on GCE node
I20260805 23:05:56.682003 18950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:56.683847 18950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:56.685098 18950 hybrid_clock.cc:648] HybridClock initialized: now 1785971156685051 us; error 43 us; skew 500 ppm
I20260805 23:05:56.685523 18950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:56 dist-test-slave-1vmg krb5kdc[18934](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971156, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:56.692487 18950 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:05:56.694437 18950 webserver.cc:460] Webserver started at http://127.0.0.1:44481/ using document root <none> and password file <none>
I20260805 23:05:56.695353 18950 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:56.695505 18950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:56.695843 18950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:56.699496 18950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "89d1711181934e8bbf68c91e425f0de1"
format_stamp: "Formatted at 2026-08-05 23:05:56 on dist-test-slave-1vmg"
server_key: "80fa2e0011c4a66e796a32de53cb23d3"
server_key_iv: "e7ff150b6adb0425d63bac3b72dbcddf"
server_key_version: "encryptionkey@0"
I20260805 23:05:56.700472 18950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "89d1711181934e8bbf68c91e425f0de1"
format_stamp: "Formatted at 2026-08-05 23:05:56 on dist-test-slave-1vmg"
server_key: "80fa2e0011c4a66e796a32de53cb23d3"
server_key_iv: "e7ff150b6adb0425d63bac3b72dbcddf"
server_key_version: "encryptionkey@0"
I20260805 23:05:56.706728 18950 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260805 23:05:56.711068 18976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:56.712677 18950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:05:56.712913 18950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "89d1711181934e8bbf68c91e425f0de1"
format_stamp: "Formatted at 2026-08-05 23:05:56 on dist-test-slave-1vmg"
server_key: "80fa2e0011c4a66e796a32de53cb23d3"
server_key_iv: "e7ff150b6adb0425d63bac3b72dbcddf"
server_key_version: "encryptionkey@0"
I20260805 23:05:56.713141 18950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:56.728560 18950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:56.733076 18950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:56.733412 18950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:56.752619 18950 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46299
I20260805 23:05:56.752651 19042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46299 every 8 connection(s)
I20260805 23:05:56.754225 18950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:56.758229 19043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:56.764171 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 18950
I20260805 23:05:56.764348 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:56.764784 22709 external_mini_cluster.cc:1428] Setting key aad0042a3bee8c44534018f479e109f9
I20260805 23:05:56.769960 19043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1: Bootstrap starting.
I20260805 23:05:56.774022 19043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:56.775420 19043 log.cc:824] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:56.779362 19043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1: No bootstrap required, opened a new log
I20260805 23:05:56.779627 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:56.766633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57183 (local address 127.0.0.1:46299)
0805 23:05:56.767563 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:56.767577 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:56.767627 (+ 50us) server_negotiation.cc:407] Connection header received
0805 23:05:56.769437 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:56.769465 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:56.769956 (+ 491us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:56.770357 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:56.771050 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:56.772468 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:56.774440 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:56.775273 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:56.775449 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:56.776771 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:56.776789 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:56.776813 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:56.777584 (+ 771us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:56.777670 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:56.777705 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:56.777805 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:56.778100 (+ 295us) server_negotiation.cc:299] Negotiation successful
0805 23:05:56.778443 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":420,"threads_started":1}
I20260805 23:05:56.783963 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:05:56.789498 19043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d1711181934e8bbf68c91e425f0de1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46299 } }
I20260805 23:05:56.790056 19043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:56.790159 19043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89d1711181934e8bbf68c91e425f0de1, State: Initialized, Role: FOLLOWER
I20260805 23:05:56.790822 19043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d1711181934e8bbf68c91e425f0de1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46299 } }
I20260805 23:05:56.791142 19043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:56.791287 19043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:56.791482 19043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:56.793905 19043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d1711181934e8bbf68c91e425f0de1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46299 } }
I20260805 23:05:56.794494 19043 leader_election.cc:302] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89d1711181934e8bbf68c91e425f0de1; no voters:
I20260805 23:05:56.795202 19043 leader_election.cc:288] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:56.795321 19058 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:56.796156 19049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:56.789705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47335 (local address 127.0.0.1:46299)
0805 23:05:56.789910 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:56.789917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:56.790304 (+ 387us) server_negotiation.cc:407] Connection header received
0805 23:05:56.790506 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:56.790511 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:56.790581 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:56.790669 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:56.791260 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:56.792085 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:56.793455 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:05:56.793966 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:05:56.794084 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:05:56.795275 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:56.795281 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:56.795285 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:56.795314 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:56.795367 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:56.795387 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:56.795477 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:56.795697 (+ 220us) server_negotiation.cc:299] Negotiation successful
0805 23:05:56.795826 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 23:05:56.796655 19058 raft_consensus.cc:686] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [term 1 LEADER]: Becoming Leader. State: Replica: 89d1711181934e8bbf68c91e425f0de1, State: Running, Role: LEADER
I20260805 23:05:56.797384 19058 consensus_queue.cc:237] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d1711181934e8bbf68c91e425f0de1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46299 } }
I20260805 23:05:56.797806 19043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:56.800379 19061 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89d1711181934e8bbf68c91e425f0de1. Latest consensus state: current_term: 1 leader_uuid: "89d1711181934e8bbf68c91e425f0de1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d1711181934e8bbf68c91e425f0de1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46299 } } }
I20260805 23:05:56.800794 19061 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:56.800786 19059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89d1711181934e8bbf68c91e425f0de1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89d1711181934e8bbf68c91e425f0de1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46299 } } }
I20260805 23:05:56.801127 19059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:56.802531 19073 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:56.808828 19073 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:56.818761 19073 catalog_manager.cc:1347] Generated new cluster ID: 0b00244073194344a970fa3a949729b3
I20260805 23:05:56.818935 19073 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:56.850011 19073 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:56.851661 19073 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:56.872071 19073 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 89d1711181934e8bbf68c91e425f0de1: Generated new TSK 0
I20260805 23:05:56.873449 19073 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:56.882026 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18950
W20260805 23:05:56.883512 19038 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57183
W20260805 23:05:56.884373 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 18950: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:05:56.884505 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 18950
2026-08-05T23:05:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2148 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:56 dist-test-slave-1vmg krb5kdc[19088](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:56 dist-test-slave-1vmg krb5kdc[19088](info): set up 2 sockets
Aug 05 23:05:56 dist-test-slave-1vmg krb5kdc[19088](info): commencing operation
krb5kdc: starting...
W20260805 23:05:58.108807 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:05:58 dist-test-slave-1vmg krb5kdc[19088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:05:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:05:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:05:58.443277 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40117
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42763
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40117
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:05:58.804152 19106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:05:58.804576 19106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:05:58.804742 19106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:05:58.812474 19106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:05:58.812655 19106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:05:58.812750 19106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:05:58.812840 19106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:05:58.812906 19106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:05:58.824105 19106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42763
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:05:58.825629 19106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:05:58.827354 19106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:05:58.840808 19113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:58.840751 19114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:05:58.840768 19118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:05:58.841452 19106 server_base.cc:1034] running on GCE node
I20260805 23:05:58.842548 19106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:05:58.844303 19106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:05:58.845569 19106 hybrid_clock.cc:648] HybridClock initialized: now 1785971158845508 us; error 54 us; skew 500 ppm
I20260805 23:05:58.846009 19106 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:05:58 dist-test-slave-1vmg krb5kdc[19088](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971158, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:05:58.849611 19106 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:05:58.851600 19106 webserver.cc:460] Webserver started at http://127.0.0.1:33593/ using document root <none> and password file <none>
I20260805 23:05:58.852376 19106 fs_manager.cc:359] Metadata directory not provided
I20260805 23:05:58.852502 19106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:05:58.852844 19106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:05:58.856474 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "51092bfc3ea04ae9a912af04bdc4cee2"
format_stamp: "Formatted at 2026-08-05 23:05:58 on dist-test-slave-1vmg"
server_key: "7cc8961d936711b92d464359ee7f6dc6"
server_key_iv: "cbd177cde594229cd5bbc4fa4a030cd6"
server_key_version: "encryptionkey@0"
I20260805 23:05:58.857452 19106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "51092bfc3ea04ae9a912af04bdc4cee2"
format_stamp: "Formatted at 2026-08-05 23:05:58 on dist-test-slave-1vmg"
server_key: "7cc8961d936711b92d464359ee7f6dc6"
server_key_iv: "cbd177cde594229cd5bbc4fa4a030cd6"
server_key_version: "encryptionkey@0"
I20260805 23:05:58.863612 19106 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260805 23:05:58.867715 19128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:05:58.869333 19106 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.003s
I20260805 23:05:58.869540 19106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "51092bfc3ea04ae9a912af04bdc4cee2"
format_stamp: "Formatted at 2026-08-05 23:05:58 on dist-test-slave-1vmg"
server_key: "7cc8961d936711b92d464359ee7f6dc6"
server_key_iv: "cbd177cde594229cd5bbc4fa4a030cd6"
server_key_version: "encryptionkey@0"
I20260805 23:05:58.869768 19106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:05:58.876509 19106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:05:58.881619 19106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:05:58.881979 19106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:05:58.901858 19106 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40117
I20260805 23:05:58.901891 19194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40117 every 8 connection(s)
I20260805 23:05:58.903487 19106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:05:58.906821 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 19106
I20260805 23:05:58.907043 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:05:58.907508 22709 external_mini_cluster.cc:1428] Setting key 56e2bc37b94d3b93076c6973c45547ec
I20260805 23:05:58.907964 19195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:05:58.916810 19200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:58.909384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51601 (local address 127.0.0.1:40117)
0805 23:05:58.910261 (+ 877us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:58.910274 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:58.910321 (+ 47us) server_negotiation.cc:407] Connection header received
0805 23:05:58.912904 (+ 2583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:58.912932 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:58.913375 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:58.913787 (+ 412us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:58.915092 (+ 1305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:58.915098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:58.915113 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:58.915139 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:58.915207 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:58.915234 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:58.915428 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:58.915547 (+ 119us) server_negotiation.cc:299] Negotiation successful
0805 23:05:58.915768 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":644,"thread_start_us":403,"threads_started":1}
I20260805 23:05:58.920754 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:05:58.922343 19195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2: Bootstrap starting.
I20260805 23:05:58.926676 19195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2: Neither blocks nor log segments found. Creating new log.
I20260805 23:05:58.928049 19195 log.cc:824] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2: Log is configured to *not* fsync() on all Append() calls
I20260805 23:05:58.928653 19200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:05:58.926016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45631 (local address 127.0.0.1:40117)
0805 23:05:58.926210 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0805 23:05:58.926217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:05:58.926614 (+ 397us) server_negotiation.cc:407] Connection header received
0805 23:05:58.926762 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:05:58.926767 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:05:58.926837 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:05:58.927013 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:05:58.927980 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:05:58.927984 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:05:58.927987 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:05:58.928003 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:05:58.928050 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:05:58.928066 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:05:58.928159 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0805 23:05:58.928298 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 23:05:58.928358 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 23:05:58.931110 19195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2: No bootstrap required, opened a new log
I20260805 23:05:58.938908 19195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260805 23:05:58.939543 19195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:05:58.939657 19195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51092bfc3ea04ae9a912af04bdc4cee2, State: Initialized, Role: FOLLOWER
I20260805 23:05:58.940312 19195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260805 23:05:58.940551 19195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:05:58.940699 19195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:05:58.940865 19195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:05:58.943316 19195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260805 23:05:58.943863 19195 leader_election.cc:302] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51092bfc3ea04ae9a912af04bdc4cee2; no voters:
I20260805 23:05:58.944500 19195 leader_election.cc:288] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:05:58.944631 19208 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:05:58.945307 19208 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [term 1 LEADER]: Becoming Leader. State: Replica: 51092bfc3ea04ae9a912af04bdc4cee2, State: Running, Role: LEADER
I20260805 23:05:58.945943 19208 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } }
I20260805 23:05:58.946790 19195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:05:58.948939 19209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } } }
I20260805 23:05:58.949234 19212 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51092bfc3ea04ae9a912af04bdc4cee2. Latest consensus state: current_term: 1 leader_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51092bfc3ea04ae9a912af04bdc4cee2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40117 } } }
I20260805 23:05:58.949429 19209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:58.949501 19212 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2 [sys.catalog]: This master's current role is: LEADER
I20260805 23:05:58.951007 19221 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:05:58.957618 19221 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:05:58.968578 19221 catalog_manager.cc:1347] Generated new cluster ID: 81eb972af59c4842bf6fdfb0a4717b94
I20260805 23:05:58.968732 19221 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:05:58.988829 19221 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:05:58.989332 19221 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:05:59.005532 19221 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51092bfc3ea04ae9a912af04bdc4cee2: Generated new TSK 0
I20260805 23:05:59.006579 19221 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:05:59.017459 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19106
W20260805 23:05:59.019196 19188 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51601
W20260805 23:05:59.020068 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19106: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:05:59.020255 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 19106
2026-08-05T23:05:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2141 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:05:59 dist-test-slave-1vmg krb5kdc[19238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:05:59 dist-test-slave-1vmg krb5kdc[19238](info): set up 2 sockets
Aug 05 23:05:59 dist-test-slave-1vmg krb5kdc[19238](info): commencing operation
krb5kdc: starting...
W20260805 23:06:00.245647 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.178s user 0.001s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:00 dist-test-slave-1vmg krb5kdc[19238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:06:00.576435 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43975
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43975
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:00.938122 19254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:00.938464 19254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:00.938609 19254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:00.946059 19254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:00.946199 19254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:00.946290 19254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:00.946368 19254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:00.946429 19254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:00.956441 19254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43975
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:00.957793 19254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:00.959165 19254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:00.970880 19261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:00.970943 19262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:00.970983 19264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:00.972064 19254 server_base.cc:1034] running on GCE node
I20260805 23:06:00.972904 19254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:00.974478 19254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:00.975693 19254 hybrid_clock.cc:648] HybridClock initialized: now 1785971160975652 us; error 37 us; skew 500 ppm
I20260805 23:06:00.976078 19254 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:00 dist-test-slave-1vmg krb5kdc[19238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971160, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:00.979403 19254 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:06:00.981051 19254 webserver.cc:460] Webserver started at http://127.0.0.1:43701/ using document root <none> and password file <none>
I20260805 23:06:00.981791 19254 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:00.981921 19254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:00.982244 19254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:00.985498 19254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89"
format_stamp: "Formatted at 2026-08-05 23:06:00 on dist-test-slave-1vmg"
server_key: "e8d5cf7f219e2cc31dfd2642fa1564ac"
server_key_iv: "0bf17d38d14d1709f1b7ca676f24fdc7"
server_key_version: "encryptionkey@0"
I20260805 23:06:00.986344 19254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89"
format_stamp: "Formatted at 2026-08-05 23:06:00 on dist-test-slave-1vmg"
server_key: "e8d5cf7f219e2cc31dfd2642fa1564ac"
server_key_iv: "0bf17d38d14d1709f1b7ca676f24fdc7"
server_key_version: "encryptionkey@0"
I20260805 23:06:00.992205 19254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260805 23:06:00.996192 19277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:00.997769 19254 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:06:00.997996 19254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89"
format_stamp: "Formatted at 2026-08-05 23:06:00 on dist-test-slave-1vmg"
server_key: "e8d5cf7f219e2cc31dfd2642fa1564ac"
server_key_iv: "0bf17d38d14d1709f1b7ca676f24fdc7"
server_key_version: "encryptionkey@0"
I20260805 23:06:00.998226 19254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:01.034579 19254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:01.038815 19254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:01.039160 19254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:01.058105 19254 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43975
I20260805 23:06:01.058159 19350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43975 every 8 connection(s)
I20260805 23:06:01.059605 19254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:01.060158 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 19254
I20260805 23:06:01.060325 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:01.060915 22709 external_mini_cluster.cc:1428] Setting key c2ffe5550bb406e937d70c68d03f4e86
I20260805 23:06:01.064072 19351 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:06:01 dist-test-slave-1vmg krb5kdc[19238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 23:06:01.075129 19351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89: Bootstrap starting.
I20260805 23:06:01.078557 19351 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:01.079826 19351 log.cc:824] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:01.083428 19351 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89: No bootstrap required, opened a new log
I20260805 23:06:01.084031 19355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:01.062825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:37381 (local address 127.0.0.1:43975)
0805 23:06:01.063636 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:01.063648 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:01.063686 (+ 38us) server_negotiation.cc:407] Connection header received
0805 23:06:01.065378 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:01.065402 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:01.065804 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:01.066141 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:01.067708 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:01.069118 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:01.070379 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:01.071110 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:01.071282 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:01.075813 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:01.075822 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:01.075840 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:01.075888 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:01.079163 (+ 3275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:01.080103 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:01.080110 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:01.080117 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:01.080308 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:01.080885 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:01.080890 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:01.080893 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:01.081580 (+ 687us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:01.081845 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:01.082387 (+ 542us) server_negotiation.cc:299] Negotiation successful
0805 23:06:01.082704 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":328,"threads_started":1}
I20260805 23:06:01.088414 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:01.092113 19351 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43975 } }
I20260805 23:06:01.092518 19351 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:01.092929 19351 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f9b6dfbd1fc4bd49eda313da0b46f89, State: Initialized, Role: FOLLOWER
I20260805 23:06:01.093786 19351 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43975 } }
I20260805 23:06:01.094113 19351 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:01.094269 19351 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:01.094478 19351 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:01.097558 19351 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43975 } }
I20260805 23:06:01.098279 19351 leader_election.cc:302] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f9b6dfbd1fc4bd49eda313da0b46f89; no voters:
I20260805 23:06:01.099162 19351 leader_election.cc:288] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:01.099323 19364 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:01.104971 19364 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [term 1 LEADER]: Becoming Leader. State: Replica: 5f9b6dfbd1fc4bd49eda313da0b46f89, State: Running, Role: LEADER
I20260805 23:06:01.105746 19364 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43975 } }
I20260805 23:06:01.106134 19351 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:01.108933 19367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f9b6dfbd1fc4bd49eda313da0b46f89. Latest consensus state: current_term: 1 leader_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43975 } } }
I20260805 23:06:01.109400 19367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:01.109965 19365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f9b6dfbd1fc4bd49eda313da0b46f89" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43975 } } }
I20260805 23:06:01.110313 19365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:01.113130 19355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:01.092811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:52339 (local address 127.0.0.1:43975)
0805 23:06:01.093047 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:01.093054 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:01.093475 (+ 421us) server_negotiation.cc:407] Connection header received
0805 23:06:01.093626 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:01.093631 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:01.093701 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:01.093810 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:01.095974 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:01.096821 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:01.098590 (+ 1769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:01.099470 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:01.099622 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:01.104139 (+ 4517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:01.104148 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:01.104154 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:01.104226 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:01.108514 (+ 4288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:01.109845 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:01.109851 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:01.109855 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:01.110077 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:01.110770 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:01.110774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:01.110778 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:01.111250 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:01.112259 (+ 1009us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:01.112460 (+ 201us) server_negotiation.cc:299] Negotiation successful
0805 23:06:01.112686 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260805 23:06:01.114893 19374 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:01.120572 19374 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:01.130769 19374 catalog_manager.cc:1347] Generated new cluster ID: aeae412008a14cf3b475fa038dafa6ab
I20260805 23:06:01.130954 19374 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:01.164414 19374 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:01.166257 19374 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:01.181380 19374 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f9b6dfbd1fc4bd49eda313da0b46f89: Generated new TSK 0
I20260805 23:06:01.182554 19374 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:01.202445 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19254
I20260805 23:06:01.204456 19345 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:01.304911 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 19254
W20260805 23:06:01.337329 19236 connection.cc:535] client connection to 127.0.0.1:43975 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43975): Connection reset by peer (error 104)
2026-08-05T23:06:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2291 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:01 dist-test-slave-1vmg krb5kdc[19396](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:01 dist-test-slave-1vmg krb5kdc[19396](info): set up 2 sockets
Aug 05 23:06:01 dist-test-slave-1vmg krb5kdc[19396](info): commencing operation
krb5kdc: starting...
W20260805 23:06:02.550557 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:02 dist-test-slave-1vmg krb5kdc[19396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:06:02.885968 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37845
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37845
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:03.257625 19414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:03.257992 19414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:03.258111 19414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:03.266034 19414 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:03.266250 19414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:03.266340 19414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:03.266427 19414 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:03.266486 19414 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:03.277424 19414 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37845
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:03.278976 19414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:03.280558 19414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:03.297122 19423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:03.297140 19427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:03.297870 19422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:03.297884 19414 server_base.cc:1034] running on GCE node
I20260805 23:06:03.299223 19414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:03.300944 19414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:03.302206 19414 hybrid_clock.cc:648] HybridClock initialized: now 1785971163302149 us; error 57 us; skew 500 ppm
I20260805 23:06:03.302665 19414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:03 dist-test-slave-1vmg krb5kdc[19396](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971163, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:03.306465 19414 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:06:03.308368 19414 webserver.cc:460] Webserver started at http://127.0.0.1:36373/ using document root <none> and password file <none>
I20260805 23:06:03.309192 19414 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:03.309337 19414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:03.309695 19414 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:03.313956 19414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "69822c35de0a481bb23e0a96d299022f"
format_stamp: "Formatted at 2026-08-05 23:06:03 on dist-test-slave-1vmg"
server_key: "a57f5e28326082e410bc3a455281b2da"
server_key_iv: "ccc6d37bb82b3e51092ed9a572699c89"
server_key_version: "encryptionkey@0"
I20260805 23:06:03.315106 19414 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "69822c35de0a481bb23e0a96d299022f"
format_stamp: "Formatted at 2026-08-05 23:06:03 on dist-test-slave-1vmg"
server_key: "a57f5e28326082e410bc3a455281b2da"
server_key_iv: "ccc6d37bb82b3e51092ed9a572699c89"
server_key_version: "encryptionkey@0"
I20260805 23:06:03.321564 19414 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:06:03.326119 19436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:03.328161 19414 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:06:03.328400 19414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "69822c35de0a481bb23e0a96d299022f"
format_stamp: "Formatted at 2026-08-05 23:06:03 on dist-test-slave-1vmg"
server_key: "a57f5e28326082e410bc3a455281b2da"
server_key_iv: "ccc6d37bb82b3e51092ed9a572699c89"
server_key_version: "encryptionkey@0"
I20260805 23:06:03.328672 19414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:03.360432 19414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:03.365509 19414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:03.365830 19414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:03.385612 19414 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37845
I20260805 23:06:03.385636 19510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37845 every 8 connection(s)
I20260805 23:06:03.387219 19414 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:03.391534 19511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:03.391762 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 19414
I20260805 23:06:03.391963 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:03.392568 22709 external_mini_cluster.cc:1428] Setting key 8f557402184aa8ce3a96106f78ab98f0
I20260805 23:06:03.406126 19511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f: Bootstrap starting.
I20260805 23:06:03.410445 19511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:03.411859 19511 log.cc:824] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:03.412043 19516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:03.394983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:38481 (local address 127.0.0.1:37845)
0805 23:06:03.399649 (+ 4666us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:03.399664 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:03.399743 (+ 79us) server_negotiation.cc:407] Connection header received
0805 23:06:03.401594 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:03.401624 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:03.402196 (+ 572us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:03.402616 (+ 420us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:03.403467 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:03.404914 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:03.406857 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:03.407707 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:03.407893 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:03.409389 (+ 1496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:03.409398 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:03.409415 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:03.410052 (+ 637us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:03.410144 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:03.410175 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:03.410319 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:03.410696 (+ 377us) server_negotiation.cc:299] Negotiation successful
0805 23:06:03.410880 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4375,"thread_start_us":4077,"threads_started":1}
I20260805 23:06:03.415287 19511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f: No bootstrap required, opened a new log
I20260805 23:06:03.416412 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:03.424237 19511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69822c35de0a481bb23e0a96d299022f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37845 } }
I20260805 23:06:03.424867 19511 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:03.424990 19511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69822c35de0a481bb23e0a96d299022f, State: Initialized, Role: FOLLOWER
I20260805 23:06:03.425766 19511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69822c35de0a481bb23e0a96d299022f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37845 } }
I20260805 23:06:03.426038 19511 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:03.426196 19511 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:03.426373 19511 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:03.428581 19516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:03.421182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:43713 (local address 127.0.0.1:37845)
0805 23:06:03.421390 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:03.421396 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:03.421726 (+ 330us) server_negotiation.cc:407] Connection header received
0805 23:06:03.421956 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:03.421960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:03.422032 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:03.422138 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:03.422781 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:03.423697 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:03.425676 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:03.426278 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:03.426435 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:03.427776 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:03.427781 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:03.427786 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:03.427811 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:03.427858 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:03.427877 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:03.427974 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:03.428173 (+ 199us) server_negotiation.cc:299] Negotiation successful
0805 23:06:03.428228 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260805 23:06:03.429589 19511 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69822c35de0a481bb23e0a96d299022f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37845 } }
I20260805 23:06:03.430202 19511 leader_election.cc:302] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69822c35de0a481bb23e0a96d299022f; no voters:
I20260805 23:06:03.430893 19511 leader_election.cc:288] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:03.431241 19529 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:03.431996 19529 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [term 1 LEADER]: Becoming Leader. State: Replica: 69822c35de0a481bb23e0a96d299022f, State: Running, Role: LEADER
I20260805 23:06:03.432827 19529 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69822c35de0a481bb23e0a96d299022f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37845 } }
I20260805 23:06:03.435252 19529 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69822c35de0a481bb23e0a96d299022f. Latest consensus state: current_term: 1 leader_uuid: "69822c35de0a481bb23e0a96d299022f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69822c35de0a481bb23e0a96d299022f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37845 } } }
I20260805 23:06:03.435581 19529 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:03.436894 19532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69822c35de0a481bb23e0a96d299022f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69822c35de0a481bb23e0a96d299022f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37845 } } }
I20260805 23:06:03.437251 19532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:03.437920 19511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:03.439095 19534 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:03.445489 19534 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:03.457424 19534 catalog_manager.cc:1347] Generated new cluster ID: 206b1a2f5cd54abba48f88cc378aa285
I20260805 23:06:03.457623 19534 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:03.470458 19534 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:03.472415 19534 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:03.483254 19534 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69822c35de0a481bb23e0a96d299022f: Generated new TSK 0
I20260805 23:06:03.484444 19534 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:03.504969 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19414
W20260805 23:06:03.506335 19504 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.118:38481
W20260805 23:06:03.507185 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19414: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:03.507318 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 19414
W20260805 23:06:03.530162 19394 connection.cc:535] client connection to 127.0.0.1:37845 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37845): Connection reset by peer (error 104)
2026-08-05T23:06:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2192 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:03 dist-test-slave-1vmg krb5kdc[19555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:03 dist-test-slave-1vmg krb5kdc[19555](info): set up 2 sockets
Aug 05 23:06:03 dist-test-slave-1vmg krb5kdc[19555](info): commencing operation
krb5kdc: starting...
W20260805 23:06:04.726490 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.176s user 0.000s sys 0.050s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:04 dist-test-slave-1vmg krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971164, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:06:05.060420 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46589
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46589
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:05.438743 19572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:05.439147 19572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:05.439297 19572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:05.447044 19572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:05.447190 19572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:05.447271 19572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:05.447364 19572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:05.447423 19572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:05.458065 19572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:05.459594 19572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:05.461036 19572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:05.473174 19584 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:05.473210 19579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:05.473155 19578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:05.474346 19572 server_base.cc:1034] running on GCE node
I20260805 23:06:05.475248 19572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:05.476779 19572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:05.478055 19572 hybrid_clock.cc:648] HybridClock initialized: now 1785971165477989 us; error 39 us; skew 500 ppm
I20260805 23:06:05.478484 19572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:05 dist-test-slave-1vmg krb5kdc[19555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971165, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:05.482139 19572 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:06:05.483848 19572 webserver.cc:460] Webserver started at http://127.0.0.1:41225/ using document root <none> and password file <none>
I20260805 23:06:05.484673 19572 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:05.484798 19572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:05.485093 19572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:05.489713 19572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "6befbc28a8f84a898d5e1d01576b354f"
format_stamp: "Formatted at 2026-08-05 23:06:05 on dist-test-slave-1vmg"
server_key: "6c51e2cc88c644d5ddea59f9b7b43c2d"
server_key_iv: "fc41d21f10d53f7307f3f4c9cbf94378"
server_key_version: "encryptionkey@0"
I20260805 23:06:05.491262 19572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "6befbc28a8f84a898d5e1d01576b354f"
format_stamp: "Formatted at 2026-08-05 23:06:05 on dist-test-slave-1vmg"
server_key: "6c51e2cc88c644d5ddea59f9b7b43c2d"
server_key_iv: "fc41d21f10d53f7307f3f4c9cbf94378"
server_key_version: "encryptionkey@0"
I20260805 23:06:05.497828 19572 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:06:05.502291 19595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:05.504067 19572 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260805 23:06:05.504290 19572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "6befbc28a8f84a898d5e1d01576b354f"
format_stamp: "Formatted at 2026-08-05 23:06:05 on dist-test-slave-1vmg"
server_key: "6c51e2cc88c644d5ddea59f9b7b43c2d"
server_key_iv: "fc41d21f10d53f7307f3f4c9cbf94378"
server_key_version: "encryptionkey@0"
I20260805 23:06:05.504539 19572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:05.511307 19572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:05.517359 19572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:05.517685 19572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:05.538247 19572 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46589
I20260805 23:06:05.538281 19669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46589 every 8 connection(s)
I20260805 23:06:05.540050 19572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:05.545811 19671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:05.546218 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 19572
I20260805 23:06:05.546425 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:05.546876 22709 external_mini_cluster.cc:1428] Setting key 467bc8e6a2ec6efff7c073d39d9e1607
I20260805 23:06:05.555991 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:05.549124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:44061 (local address 127.0.0.1:46589)
0805 23:06:05.550173 (+ 1049us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:05.550187 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:05.550240 (+ 53us) server_negotiation.cc:407] Connection header received
0805 23:06:05.551970 (+ 1730us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:05.552000 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:05.552458 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:05.552885 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:05.554091 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:05.554098 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:05.554115 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:05.554135 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:05.554208 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:05.554235 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:05.554475 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:05.554663 (+ 188us) server_negotiation.cc:299] Negotiation successful
0805 23:06:05.554869 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":767,"thread_start_us":439,"threads_started":1}
I20260805 23:06:05.560559 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:05.561971 19671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f: Bootstrap starting.
I20260805 23:06:05.565886 19671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:05.567498 19671 log.cc:824] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:05.568215 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:05.565218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:54339 (local address 127.0.0.1:46589)
0805 23:06:05.565437 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:05.565445 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:05.565998 (+ 553us) server_negotiation.cc:407] Connection header received
0805 23:06:05.566206 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:05.566209 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:05.566267 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:05.566367 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:05.567478 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:05.567486 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:05.567490 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:05.567508 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:05.567555 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:05.567578 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:05.567712 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:05.567834 (+ 122us) server_negotiation.cc:299] Negotiation successful
0805 23:06:05.567893 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:06:05.570989 19671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f: No bootstrap required, opened a new log
I20260805 23:06:05.579223 19671 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6befbc28a8f84a898d5e1d01576b354f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46589 } }
I20260805 23:06:05.579665 19671 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:05.579764 19671 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6befbc28a8f84a898d5e1d01576b354f, State: Initialized, Role: FOLLOWER
I20260805 23:06:05.580401 19671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6befbc28a8f84a898d5e1d01576b354f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46589 } }
I20260805 23:06:05.580647 19671 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:05.580760 19671 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:05.580893 19671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:05.583542 19671 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6befbc28a8f84a898d5e1d01576b354f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46589 } }
I20260805 23:06:05.584179 19671 leader_election.cc:302] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6befbc28a8f84a898d5e1d01576b354f; no voters:
I20260805 23:06:05.584813 19671 leader_election.cc:288] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:05.584972 19689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:05.585688 19689 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [term 1 LEADER]: Becoming Leader. State: Replica: 6befbc28a8f84a898d5e1d01576b354f, State: Running, Role: LEADER
I20260805 23:06:05.586300 19689 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6befbc28a8f84a898d5e1d01576b354f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46589 } }
I20260805 23:06:05.587000 19671 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:05.589473 19691 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6befbc28a8f84a898d5e1d01576b354f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6befbc28a8f84a898d5e1d01576b354f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46589 } } }
I20260805 23:06:05.589982 19691 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:05.590895 19692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6befbc28a8f84a898d5e1d01576b354f. Latest consensus state: current_term: 1 leader_uuid: "6befbc28a8f84a898d5e1d01576b354f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6befbc28a8f84a898d5e1d01576b354f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46589 } } }
I20260805 23:06:05.591353 19692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:05.592702 19704 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:05.598414 19704 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:05.609011 19704 catalog_manager.cc:1347] Generated new cluster ID: c6acf49fb8614e6e94c37726fda2012b
I20260805 23:06:05.609175 19704 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:05.629804 19704 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:05.630363 19704 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:05.638149 19704 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6befbc28a8f84a898d5e1d01576b354f: Generated new TSK 0
I20260805 23:06:05.639182 19704 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:05.643724 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19572
W20260805 23:06:05.645653 19662 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.118:44061
W20260805 23:06:05.646417 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19572: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:05.646590 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 19572
2026-08-05T23:06:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2141 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:05 dist-test-slave-1vmg krb5kdc[19723](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:05 dist-test-slave-1vmg krb5kdc[19723](info): set up 2 sockets
Aug 05 23:06:05 dist-test-slave-1vmg krb5kdc[19723](info): commencing operation
krb5kdc: starting...
W20260805 23:06:06.870692 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:07 dist-test-slave-1vmg krb5kdc[19723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:06:07.204471 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35123
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:07.573954 19743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:07.574306 19743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:07.574438 19743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:07.582041 19743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:07.582199 19743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:07.582259 19743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:07.582350 19743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:07.582406 19743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:07.593055 19743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35123
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:07.594543 19743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:07.596012 19743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:07.608958 19749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:07.609014 19750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:07.608989 19752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:07.610069 19743 server_base.cc:1034] running on GCE node
I20260805 23:06:07.610998 19743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:07.612622 19743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:07.613847 19743 hybrid_clock.cc:648] HybridClock initialized: now 1785971167613801 us; error 44 us; skew 500 ppm
I20260805 23:06:07.614204 19743 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:07 dist-test-slave-1vmg krb5kdc[19723](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971167, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:07.621294 19743 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:06:07.623068 19743 webserver.cc:460] Webserver started at http://127.0.0.1:33049/ using document root <none> and password file <none>
I20260805 23:06:07.623870 19743 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:07.624010 19743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:07.624346 19743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:07.627977 19743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "9cf1154b63784c9da5ba496bb9a07326"
format_stamp: "Formatted at 2026-08-05 23:06:07 on dist-test-slave-1vmg"
server_key: "4eabc56a372940b51b2a06781af241aa"
server_key_iv: "0c4c1eb9d1294ebabd1eb1fb43ad7364"
server_key_version: "encryptionkey@0"
I20260805 23:06:07.628898 19743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "9cf1154b63784c9da5ba496bb9a07326"
format_stamp: "Formatted at 2026-08-05 23:06:07 on dist-test-slave-1vmg"
server_key: "4eabc56a372940b51b2a06781af241aa"
server_key_iv: "0c4c1eb9d1294ebabd1eb1fb43ad7364"
server_key_version: "encryptionkey@0"
I20260805 23:06:07.635223 19743 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 23:06:07.639495 19762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:07.641101 19743 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:06:07.641335 19743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "9cf1154b63784c9da5ba496bb9a07326"
format_stamp: "Formatted at 2026-08-05 23:06:07 on dist-test-slave-1vmg"
server_key: "4eabc56a372940b51b2a06781af241aa"
server_key_iv: "0c4c1eb9d1294ebabd1eb1fb43ad7364"
server_key_version: "encryptionkey@0"
I20260805 23:06:07.641571 19743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:07.667506 19743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:07.672394 19743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:07.672761 19743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:07.693852 19743 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35123
I20260805 23:06:07.693874 19842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35123 every 8 connection(s)
I20260805 23:06:07.695633 19743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:07.698961 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 19743
I20260805 23:06:07.699179 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:07.699693 22709 external_mini_cluster.cc:1428] Setting key 6481ef401d036a9f31002c5230d86b80
I20260805 23:06:07.700241 19843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:07.715911 19843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326: Bootstrap starting.
Aug 05 23:06:07 dist-test-slave-1vmg krb5kdc[19723](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971167, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260805 23:06:07.720395 19843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:07.722189 19843 log.cc:824] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:07.726486 19843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326: No bootstrap required, opened a new log
I20260805 23:06:07.728370 19848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:07.701879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:38631 (local address 127.0.0.1:35123)
0805 23:06:07.702737 (+ 858us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:07.702752 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:07.702803 (+ 51us) server_negotiation.cc:407] Connection header received
0805 23:06:07.705301 (+ 2498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:07.705334 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:07.705926 (+ 592us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:07.706432 (+ 506us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:07.707970 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:07.710043 (+ 2073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:07.711609 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:07.712818 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:07.713037 (+ 219us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:07.717806 (+ 4769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:07.717821 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:07.717843 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:07.717908 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:07.722429 (+ 4521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:07.723890 (+ 1461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:07.723899 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:07.723907 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:07.724197 (+ 290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:07.724825 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:07.724831 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:07.724834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:07.725606 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:07.725992 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:07.726460 (+ 468us) server_negotiation.cc:299] Negotiation successful
0805 23:06:07.726865 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":368,"threads_started":1}
I20260805 23:06:07.732673 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:07.735642 19843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cf1154b63784c9da5ba496bb9a07326" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260805 23:06:07.736093 19843 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:07.736203 19843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cf1154b63784c9da5ba496bb9a07326, State: Initialized, Role: FOLLOWER
I20260805 23:06:07.737078 19843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cf1154b63784c9da5ba496bb9a07326" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260805 23:06:07.737457 19843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:07.737706 19843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:07.737907 19843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:07.740777 19843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cf1154b63784c9da5ba496bb9a07326" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260805 23:06:07.741533 19843 leader_election.cc:302] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cf1154b63784c9da5ba496bb9a07326; no voters:
I20260805 23:06:07.742234 19843 leader_election.cc:288] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:07.742352 19862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:07.743613 19862 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [term 1 LEADER]: Becoming Leader. State: Replica: 9cf1154b63784c9da5ba496bb9a07326, State: Running, Role: LEADER
I20260805 23:06:07.744342 19862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cf1154b63784c9da5ba496bb9a07326" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } }
I20260805 23:06:07.744983 19843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:07.747646 19864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9cf1154b63784c9da5ba496bb9a07326. Latest consensus state: current_term: 1 leader_uuid: "9cf1154b63784c9da5ba496bb9a07326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cf1154b63784c9da5ba496bb9a07326" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } } }
I20260805 23:06:07.748257 19864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:07.748773 19863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9cf1154b63784c9da5ba496bb9a07326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cf1154b63784c9da5ba496bb9a07326" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35123 } } }
I20260805 23:06:07.749303 19863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:07.757479 19848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:07.737431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:52467 (local address 127.0.0.1:35123)
0805 23:06:07.737617 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:07.737623 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:07.738037 (+ 414us) server_negotiation.cc:407] Connection header received
0805 23:06:07.738227 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:07.738234 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:07.738329 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:07.738447 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:07.740160 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:07.741256 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:07.742611 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:07.743338 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:07.743484 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:07.746693 (+ 3209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:07.746701 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:07.746705 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:07.746756 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:07.752036 (+ 5280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:07.753463 (+ 1427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:07.753470 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:07.753474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:07.753698 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:07.754318 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:07.754323 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:07.754327 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:07.754870 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:07.756619 (+ 1749us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:07.756827 (+ 208us) server_negotiation.cc:299] Negotiation successful
0805 23:06:07.757052 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260805 23:06:07.759992 19867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:07.766356 19867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:07.777043 19867 catalog_manager.cc:1347] Generated new cluster ID: 209b3af627004043a0b40154fdf1433f
I20260805 23:06:07.777206 19867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:07.797544 19867 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:07.799216 19867 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:07.815737 19867 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9cf1154b63784c9da5ba496bb9a07326: Generated new TSK 0
I20260805 23:06:07.816764 19867 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:07.823534 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19743
I20260805 23:06:07.824779 19836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:07.918583 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 19743
W20260805 23:06:07.940934 19720 connection.cc:535] client connection to 127.0.0.1:35123 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35123): Connection reset by peer (error 104)
2026-08-05T23:06:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2273 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:08 dist-test-slave-1vmg krb5kdc[19891](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:08 dist-test-slave-1vmg krb5kdc[19891](info): set up 2 sockets
Aug 05 23:06:08 dist-test-slave-1vmg krb5kdc[19891](info): commencing operation
krb5kdc: starting...
W20260805 23:06:09.149019 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.184s user 0.002s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:09 dist-test-slave-1vmg krb5kdc[19891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:06:09.475891 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40187
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40187
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:09.848896 19911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:09.849248 19911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:09.849398 19911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:09.857113 19911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:09.857268 19911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:09.857353 19911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:09.857447 19911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:09.857508 19911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:09.868144 19911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40187
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:09.869592 19911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:09.870900 19911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:09.882822 19921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:09.882776 19919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:09.882858 19916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:09.884021 19911 server_base.cc:1034] running on GCE node
I20260805 23:06:09.884948 19911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:09.886475 19911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:09.887704 19911 hybrid_clock.cc:648] HybridClock initialized: now 1785971169887656 us; error 47 us; skew 500 ppm
I20260805 23:06:09.888078 19911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:09 dist-test-slave-1vmg krb5kdc[19891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971169, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:09.891609 19911 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:06:09.893304 19911 webserver.cc:460] Webserver started at http://127.0.0.1:37835/ using document root <none> and password file <none>
I20260805 23:06:09.894063 19911 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:09.894205 19911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:09.894532 19911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:09.897883 19911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "dc150dc91b714a7bb13289d6f2c15b2d"
format_stamp: "Formatted at 2026-08-05 23:06:09 on dist-test-slave-1vmg"
server_key: "d62ea38fdb79d8fafb2fb9175a275a9b"
server_key_iv: "d5959391712d4c6d4ad3bfe1ca43c059"
server_key_version: "encryptionkey@0"
I20260805 23:06:09.898767 19911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "dc150dc91b714a7bb13289d6f2c15b2d"
format_stamp: "Formatted at 2026-08-05 23:06:09 on dist-test-slave-1vmg"
server_key: "d62ea38fdb79d8fafb2fb9175a275a9b"
server_key_iv: "d5959391712d4c6d4ad3bfe1ca43c059"
server_key_version: "encryptionkey@0"
I20260805 23:06:09.904461 19911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:06:09.908486 19930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:09.910009 19911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260805 23:06:09.910211 19911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "dc150dc91b714a7bb13289d6f2c15b2d"
format_stamp: "Formatted at 2026-08-05 23:06:09 on dist-test-slave-1vmg"
server_key: "d62ea38fdb79d8fafb2fb9175a275a9b"
server_key_iv: "d5959391712d4c6d4ad3bfe1ca43c059"
server_key_version: "encryptionkey@0"
I20260805 23:06:09.910427 19911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:09.929939 19911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:09.934810 19911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:09.935174 19911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:09.954821 19911 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40187
I20260805 23:06:09.954841 19995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40187 every 8 connection(s)
I20260805 23:06:09.956413 19911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:09.960448 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:09.961125 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 19911
I20260805 23:06:09.961349 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:09.961935 22709 external_mini_cluster.cc:1428] Setting key fc0489a5f153f2d0d105933d700d70b1
I20260805 23:06:09.973724 19997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d: Bootstrap starting.
I20260805 23:06:09.976006 20003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:09.963913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:45225 (local address 127.0.0.1:40187)
0805 23:06:09.964768 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:09.964781 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:09.964831 (+ 50us) server_negotiation.cc:407] Connection header received
0805 23:06:09.967144 (+ 2313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:09.967173 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:09.967672 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:09.968079 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:09.968666 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:09.969984 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:09.971421 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:09.972139 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:09.972317 (+ 178us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:09.973572 (+ 1255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:09.973580 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:09.973595 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:09.974208 (+ 613us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:09.974298 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:09.974325 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:09.974468 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:09.974764 (+ 296us) server_negotiation.cc:299] Negotiation successful
0805 23:06:09.974964 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":363,"threads_started":1}
I20260805 23:06:09.977245 19997 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:09.978657 19997 log.cc:824] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:09.980355 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:09.981823 19997 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d: No bootstrap required, opened a new log
I20260805 23:06:09.991364 20003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:09.984797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:45345 (local address 127.0.0.1:40187)
0805 23:06:09.985002 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:09.985008 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:09.985264 (+ 256us) server_negotiation.cc:407] Connection header received
0805 23:06:09.985473 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:09.985477 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:09.985541 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:09.985634 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:09.986209 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:09.987065 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:09.988868 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:09.989326 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:09.989411 (+ 85us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:09.990592 (+ 1181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:09.990597 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:09.990600 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:09.990618 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:09.990669 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:09.990685 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:09.990774 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:09.990996 (+ 222us) server_negotiation.cc:299] Negotiation successful
0805 23:06:09.991041 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 23:06:09.991547 19997 raft_consensus.cc:348] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260805 23:06:09.992074 19997 raft_consensus.cc:374] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:09.992179 19997 raft_consensus.cc:729] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc150dc91b714a7bb13289d6f2c15b2d, State: Initialized, Role: FOLLOWER
I20260805 23:06:09.992820 19997 consensus_queue.cc:260] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260805 23:06:09.993083 19997 raft_consensus.cc:388] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:09.993216 19997 raft_consensus.cc:482] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:09.993387 19997 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:09.995710 19997 raft_consensus.cc:504] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260805 23:06:09.996287 19997 leader_election.cc:302] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dc150dc91b714a7bb13289d6f2c15b2d; no voters:
I20260805 23:06:09.996937 19997 leader_election.cc:288] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:09.997072 20014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:09.997829 20014 raft_consensus.cc:686] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [term 1 LEADER]: Becoming Leader. State: Replica: dc150dc91b714a7bb13289d6f2c15b2d, State: Running, Role: LEADER
I20260805 23:06:09.998376 20014 consensus_queue.cc:237] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } }
I20260805 23:06:09.999114 19997 sys_catalog.cc:564] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:10.000993 20015 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } } }
I20260805 23:06:10.001365 20015 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:10.002249 20023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:10.002694 20016 sys_catalog.cc:455] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader dc150dc91b714a7bb13289d6f2c15b2d. Latest consensus state: current_term: 1 leader_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dc150dc91b714a7bb13289d6f2c15b2d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40187 } } }
I20260805 23:06:10.003115 20016 sys_catalog.cc:458] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:10.008589 20023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:10.019481 20023 catalog_manager.cc:1347] Generated new cluster ID: 7792636aca5f419d9a8f512939972b12
I20260805 23:06:10.019622 20023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:10.029320 20023 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:10.030704 20023 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:10.045327 20023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dc150dc91b714a7bb13289d6f2c15b2d: Generated new TSK 0
I20260805 23:06:10.046343 20023 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:10.060895 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19911
W20260805 23:06:10.062466 19990 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.118:45225
W20260805 23:06:10.063200 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 19911: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:10.063380 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 19911
W20260805 23:06:10.085794 19888 connection.cc:535] client connection to 127.0.0.1:40187 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40187): Connection reset by peer (error 104)
2026-08-05T23:06:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2140 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:10 dist-test-slave-1vmg krb5kdc[20046](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:10 dist-test-slave-1vmg krb5kdc[20046](info): set up 2 sockets
Aug 05 23:06:10 dist-test-slave-1vmg krb5kdc[20046](info): commencing operation
krb5kdc: starting...
W20260805 23:06:11.274757 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.170s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:11 dist-test-slave-1vmg krb5kdc[20046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971171, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260805 23:06:11.602535 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45949
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:11.972714 20066 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:11.973069 20066 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:11.973227 20066 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:11.980892 20066 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:11.981047 20066 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:11.981107 20066 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:11.981204 20066 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:11.981259 20066 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:11.991942 20066 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45949
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:11.993425 20066 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:11.994867 20066 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:12.007580 20075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:12.007661 20073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:12.007726 20078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:12.008762 20066 server_base.cc:1034] running on GCE node
I20260805 23:06:12.009833 20066 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:12.011670 20066 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:12.012912 20066 hybrid_clock.cc:648] HybridClock initialized: now 1785971172012857 us; error 58 us; skew 500 ppm
I20260805 23:06:12.013310 20066 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:12 dist-test-slave-1vmg krb5kdc[20046](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971172, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:12.016975 20066 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260805 23:06:12.018656 20066 webserver.cc:460] Webserver started at http://127.0.0.1:46563/ using document root <none> and password file <none>
I20260805 23:06:12.019495 20066 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:12.019644 20066 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:12.019996 20066 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:12.023433 20066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "8be3d81a0eba479981fe5535f33e721a"
format_stamp: "Formatted at 2026-08-05 23:06:12 on dist-test-slave-1vmg"
server_key: "c28b67679ccab5d2bac60552716f4a17"
server_key_iv: "0f1a52c353fa9599ca1daea07c3c7b48"
server_key_version: "encryptionkey@0"
I20260805 23:06:12.024326 20066 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "8be3d81a0eba479981fe5535f33e721a"
format_stamp: "Formatted at 2026-08-05 23:06:12 on dist-test-slave-1vmg"
server_key: "c28b67679ccab5d2bac60552716f4a17"
server_key_iv: "0f1a52c353fa9599ca1daea07c3c7b48"
server_key_version: "encryptionkey@0"
I20260805 23:06:12.030380 20066 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260805 23:06:12.034328 20087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:12.035885 20066 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:06:12.036088 20066 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "8be3d81a0eba479981fe5535f33e721a"
format_stamp: "Formatted at 2026-08-05 23:06:12 on dist-test-slave-1vmg"
server_key: "c28b67679ccab5d2bac60552716f4a17"
server_key_iv: "0f1a52c353fa9599ca1daea07c3c7b48"
server_key_version: "encryptionkey@0"
I20260805 23:06:12.036306 20066 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:12.042845 20066 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:12.047664 20066 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:12.047992 20066 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:12.066838 20066 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45949
I20260805 23:06:12.066896 20157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45949 every 8 connection(s)
I20260805 23:06:12.068409 20066 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:12.072613 20158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:12.076170 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 20066
I20260805 23:06:12.076341 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:12.076782 22709 external_mini_cluster.cc:1428] Setting key e8a14d4db6e09ff890ec2f785b45603d
I20260805 23:06:12.085057 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:12.078751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:38835 (local address 127.0.0.1:45949)
0805 23:06:12.079582 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:12.079596 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:12.079642 (+ 46us) server_negotiation.cc:407] Connection header received
0805 23:06:12.081429 (+ 1787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:12.081453 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:12.081872 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:12.082280 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:12.083388 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:12.083394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:12.083407 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:12.083422 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:12.083492 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:12.083512 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:12.083735 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:12.083888 (+ 153us) server_negotiation.cc:299] Negotiation successful
0805 23:06:12.084086 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":363,"threads_started":1}
I20260805 23:06:12.085121 20158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a: Bootstrap starting.
I20260805 23:06:12.088912 20158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:12.089037 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:12.090067 20158 log.cc:824] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:12.093585 20158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a: No bootstrap required, opened a new log
I20260805 23:06:12.096813 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:12.093958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.118:60213 (local address 127.0.0.1:45949)
0805 23:06:12.094124 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:12.094128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:12.094722 (+ 594us) server_negotiation.cc:407] Connection header received
0805 23:06:12.094979 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:12.094982 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:12.095036 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:12.095120 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:12.096142 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:12.096146 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:12.096150 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:12.096168 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:12.096213 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:12.096229 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:12.096333 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:12.096451 (+ 118us) server_negotiation.cc:299] Negotiation successful
0805 23:06:12.096511 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260805 23:06:12.103152 20158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be3d81a0eba479981fe5535f33e721a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260805 23:06:12.103632 20158 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:12.103735 20158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8be3d81a0eba479981fe5535f33e721a, State: Initialized, Role: FOLLOWER
I20260805 23:06:12.104348 20158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be3d81a0eba479981fe5535f33e721a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260805 23:06:12.104594 20158 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:12.104735 20158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:12.104904 20158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:12.107331 20158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be3d81a0eba479981fe5535f33e721a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260805 23:06:12.107892 20158 leader_election.cc:302] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8be3d81a0eba479981fe5535f33e721a; no voters:
I20260805 23:06:12.108536 20158 leader_election.cc:288] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:12.108724 20170 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:12.109411 20170 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [term 1 LEADER]: Becoming Leader. State: Replica: 8be3d81a0eba479981fe5535f33e721a, State: Running, Role: LEADER
I20260805 23:06:12.110062 20170 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be3d81a0eba479981fe5535f33e721a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } }
I20260805 23:06:12.111301 20158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:12.113080 20173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8be3d81a0eba479981fe5535f33e721a. Latest consensus state: current_term: 1 leader_uuid: "8be3d81a0eba479981fe5535f33e721a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be3d81a0eba479981fe5535f33e721a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } } }
I20260805 23:06:12.113073 20174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8be3d81a0eba479981fe5535f33e721a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8be3d81a0eba479981fe5535f33e721a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45949 } } }
I20260805 23:06:12.113575 20173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:12.113575 20174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:12.120347 20181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:12.125880 20181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:12.135069 20181 catalog_manager.cc:1347] Generated new cluster ID: df7348a4aa474103a52170ffb67dd889
I20260805 23:06:12.135212 20181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:12.168547 20181 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:12.169178 20181 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:12.188356 20181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8be3d81a0eba479981fe5535f33e721a: Generated new TSK 0
I20260805 23:06:12.189335 20181 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:12.205137 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20066
W20260805 23:06:12.206349 20153 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.118:38835
W20260805 23:06:12.207121 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20066: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:12.207265 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 20066
2026-08-05T23:06:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2144 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:12 dist-test-slave-1vmg krb5kdc[20207](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:12 dist-test-slave-1vmg krb5kdc[20207](info): set up 2 sockets
Aug 05 23:06:12 dist-test-slave-1vmg krb5kdc[20207](info): commencing operation
krb5kdc: starting...
W20260805 23:06:13.428805 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.000s sys 0.048s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:13 dist-test-slave-1vmg krb5kdc[20207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:13.760602 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41913
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:41913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:14.132748 20226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:14.133101 20226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:14.133244 20226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:14.140938 20226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:14.141094 20226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:14.141149 20226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:14.141244 20226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:14.141295 20226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:14.151772 20226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:41913
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:41913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:14.153255 20226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:14.154717 20226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:14.168385 20238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:14.168433 20239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:14.168349 20241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:14.169689 20226 server_base.cc:1034] running on GCE node
I20260805 23:06:14.170552 20226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:14.172153 20226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:14.173377 20226 hybrid_clock.cc:648] HybridClock initialized: now 1785971174173320 us; error 46 us; skew 500 ppm
I20260805 23:06:14.173746 20226 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:14 dist-test-slave-1vmg krb5kdc[20207](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971174, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:14.179939 20226 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:14.181676 20226 webserver.cc:460] Webserver started at http://127.22.45.126:35895/ using document root <none> and password file <none>
I20260805 23:06:14.182463 20226 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:14.182602 20226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:14.182945 20226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:14.186187 20226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "c7b1e0a626ca44e98e3bd261cff9442c"
format_stamp: "Formatted at 2026-08-05 23:06:14 on dist-test-slave-1vmg"
server_key: "298d250c1ab535cf7ec452e26f00add3"
server_key_iv: "88f2937955683054c67ca739fddbed6b"
server_key_version: "encryptionkey@0"
I20260805 23:06:14.187101 20226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "c7b1e0a626ca44e98e3bd261cff9442c"
format_stamp: "Formatted at 2026-08-05 23:06:14 on dist-test-slave-1vmg"
server_key: "298d250c1ab535cf7ec452e26f00add3"
server_key_iv: "88f2937955683054c67ca739fddbed6b"
server_key_version: "encryptionkey@0"
I20260805 23:06:14.192813 20226 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:06:14.196846 20253 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:14.198397 20226 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 23:06:14.198611 20226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "c7b1e0a626ca44e98e3bd261cff9442c"
format_stamp: "Formatted at 2026-08-05 23:06:14 on dist-test-slave-1vmg"
server_key: "298d250c1ab535cf7ec452e26f00add3"
server_key_iv: "88f2937955683054c67ca739fddbed6b"
server_key_version: "encryptionkey@0"
I20260805 23:06:14.198832 20226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:14.214129 20226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:14.218894 20226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:14.219257 20226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:14.239127 20226 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:41913
I20260805 23:06:14.239130 20326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:41913 every 8 connection(s)
I20260805 23:06:14.240779 20226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:14.244834 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 20226
I20260805 23:06:14.245029 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:14.245048 20327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:14.245507 22709 external_mini_cluster.cc:1428] Setting key 03a70f26309f1fe554ee78c8452a87f9
I20260805 23:06:14.261302 20327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c: Bootstrap starting.
Aug 05 23:06:14 dist-test-slave-1vmg krb5kdc[20207](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971173, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:14.265815 20327 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:14.267482 20327 log.cc:824] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:14.271471 20327 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c: No bootstrap required, opened a new log
I20260805 23:06:14.272814 20331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:14.247547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42665 (local address 127.22.45.126:41913)
0805 23:06:14.248532 (+ 985us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:14.248549 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:14.248609 (+ 60us) server_negotiation.cc:407] Connection header received
0805 23:06:14.250545 (+ 1936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:14.250583 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:14.251273 (+ 690us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:14.251829 (+ 556us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:14.253248 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:14.255381 (+ 2133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:14.256819 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:14.257998 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:14.258216 (+ 218us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:14.263033 (+ 4817us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:14.263051 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:14.263076 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:14.263147 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:14.267473 (+ 4326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:14.268705 (+ 1232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:14.268714 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:14.268721 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:14.268932 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:14.269416 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:14.269422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:14.269425 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:14.270181 (+ 756us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:14.270522 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:14.270942 (+ 420us) server_negotiation.cc:299] Negotiation successful
0805 23:06:14.271325 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":390,"threads_started":1}
I20260805 23:06:14.277253 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:14.281864 20327 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41913 } }
I20260805 23:06:14.282511 20327 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:14.282645 20327 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7b1e0a626ca44e98e3bd261cff9442c, State: Initialized, Role: FOLLOWER
I20260805 23:06:14.283474 20327 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41913 } }
I20260805 23:06:14.283777 20327 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:14.283927 20327 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:14.284123 20327 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:14.286830 20327 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41913 } }
I20260805 23:06:14.287524 20327 leader_election.cc:302] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7b1e0a626ca44e98e3bd261cff9442c; no voters:
I20260805 23:06:14.288241 20327 leader_election.cc:288] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:14.288372 20340 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:14.290938 20327 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:14.291275 20340 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [term 1 LEADER]: Becoming Leader. State: Replica: c7b1e0a626ca44e98e3bd261cff9442c, State: Running, Role: LEADER
I20260805 23:06:14.292027 20340 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41913 } }
I20260805 23:06:14.296027 20342 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41913 } } }
I20260805 23:06:14.296496 20342 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:14.297850 20343 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7b1e0a626ca44e98e3bd261cff9442c. Latest consensus state: current_term: 1 leader_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b1e0a626ca44e98e3bd261cff9442c" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 41913 } } }
I20260805 23:06:14.298331 20343 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:14.300320 20331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:14.283229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37407 (local address 127.22.45.126:41913)
0805 23:06:14.283435 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:14.283443 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:14.283884 (+ 441us) server_negotiation.cc:407] Connection header received
0805 23:06:14.284103 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:14.284108 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:14.284179 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:14.284271 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:14.285888 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:14.286689 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:14.288171 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:14.288828 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:14.288994 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:14.292070 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:14.292075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:14.292078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:14.292115 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:14.295771 (+ 3656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:14.297064 (+ 1293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:14.297070 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:14.297073 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:14.297247 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:14.297914 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:14.297920 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:14.297924 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:14.298435 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:14.299396 (+ 961us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:14.299642 (+ 246us) server_negotiation.cc:299] Negotiation successful
0805 23:06:14.299900 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 23:06:14.302839 20350 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:14.308220 20350 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:14.318303 20350 catalog_manager.cc:1347] Generated new cluster ID: 770d2fff22eb40e4b768f24120c2480c
I20260805 23:06:14.318444 20350 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:14.339545 20350 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:14.341650 20350 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:14.360630 20350 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7b1e0a626ca44e98e3bd261cff9442c: Generated new TSK 0
I20260805 23:06:14.361820 20350 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:14.370028 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20226
I20260805 23:06:14.371207 20320 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:14.464956 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 20226
W20260805 23:06:14.485325 20205 connection.cc:535] client connection to 127.22.45.126:41913 recv error: Network error: failed to read from TLS socket (remote: 127.22.45.126:41913): Connection reset by peer (error 104)
2026-08-05T23:06:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2254 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:14 dist-test-slave-1vmg krb5kdc[20370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:14 dist-test-slave-1vmg krb5kdc[20370](info): set up 2 sockets
Aug 05 23:06:14 dist-test-slave-1vmg krb5kdc[20370](info): commencing operation
krb5kdc: starting...
W20260805 23:06:15.694222 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.190s user 0.004s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:15 dist-test-slave-1vmg krb5kdc[20370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971175, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:16.030015 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43559
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:36315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:43559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:16.388758 20387 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:16.389117 20387 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:16.389240 20387 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:16.396714 20387 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:16.396853 20387 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:16.396934 20387 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:16.397032 20387 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:16.397092 20387 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:16.407603 20387 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:43559
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:16.409046 20387 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:16.410434 20387 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:16.422673 20394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:16.422794 20395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:16.422623 20401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:16.423810 20387 server_base.cc:1034] running on GCE node
I20260805 23:06:16.424662 20387 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:16.426141 20387 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:16.427345 20387 hybrid_clock.cc:648] HybridClock initialized: now 1785971176427305 us; error 31 us; skew 500 ppm
I20260805 23:06:16.427692 20387 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:16 dist-test-slave-1vmg krb5kdc[20370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971176, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:16.430842 20387 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:16.432437 20387 webserver.cc:460] Webserver started at http://127.22.45.126:45301/ using document root <none> and password file <none>
I20260805 23:06:16.433156 20387 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:16.433279 20387 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:16.433589 20387 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:16.436770 20387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "dbf21adc5ae649a9879f7679d65e2d1e"
format_stamp: "Formatted at 2026-08-05 23:06:16 on dist-test-slave-1vmg"
server_key: "b1e78d45e9cb6026b0d49eaa32af86b5"
server_key_iv: "4ae05e9c0dd6881be9d08d0e987024b0"
server_key_version: "encryptionkey@0"
I20260805 23:06:16.437565 20387 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "dbf21adc5ae649a9879f7679d65e2d1e"
format_stamp: "Formatted at 2026-08-05 23:06:16 on dist-test-slave-1vmg"
server_key: "b1e78d45e9cb6026b0d49eaa32af86b5"
server_key_iv: "4ae05e9c0dd6881be9d08d0e987024b0"
server_key_version: "encryptionkey@0"
I20260805 23:06:16.443467 20387 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260805 23:06:16.447434 20409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:16.448921 20387 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:06:16.449115 20387 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "dbf21adc5ae649a9879f7679d65e2d1e"
format_stamp: "Formatted at 2026-08-05 23:06:16 on dist-test-slave-1vmg"
server_key: "b1e78d45e9cb6026b0d49eaa32af86b5"
server_key_iv: "4ae05e9c0dd6881be9d08d0e987024b0"
server_key_version: "encryptionkey@0"
I20260805 23:06:16.449326 20387 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:16.462630 20387 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:16.467279 20387 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:16.467594 20387 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:16.487061 20387 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:43559
I20260805 23:06:16.487079 20482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:43559 every 8 connection(s)
I20260805 23:06:16.488616 20387 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:16.492486 20483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:16.493680 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 20387
I20260805 23:06:16.493849 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:16.494274 22709 external_mini_cluster.cc:1428] Setting key 9bcda76fc3e14a0c9afeb4801885ac9f
I20260805 23:06:16.506966 20483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e: Bootstrap starting.
I20260805 23:06:16.508661 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:16.496092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47361 (local address 127.22.45.126:43559)
0805 23:06:16.496926 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:16.496938 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:16.496980 (+ 42us) server_negotiation.cc:407] Connection header received
0805 23:06:16.498721 (+ 1741us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:16.498746 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:16.499284 (+ 538us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:16.499653 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:16.500306 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:16.501619 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:16.503640 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:16.504499 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:16.504656 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:16.506069 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:16.506078 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:16.506095 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:16.506692 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:16.506795 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:16.506823 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:16.507005 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:16.507340 (+ 335us) server_negotiation.cc:299] Negotiation successful
0805 23:06:16.507573 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":359,"threads_started":1}
I20260805 23:06:16.510857 20483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:16.512248 20483 log.cc:824] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:16.513088 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:16.515974 20483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e: No bootstrap required, opened a new log
I20260805 23:06:16.525334 20486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:16.518447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37521 (local address 127.22.45.126:43559)
0805 23:06:16.518675 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:16.518685 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:16.519085 (+ 400us) server_negotiation.cc:407] Connection header received
0805 23:06:16.519265 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:16.519274 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:16.519364 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:16.519501 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:16.520046 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:16.521225 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:16.522519 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:16.523246 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:16.523409 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:16.524550 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:16.524558 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:16.524563 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:16.524587 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:16.524643 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:16.524664 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:16.524793 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:16.524915 (+ 122us) server_negotiation.cc:299] Negotiation successful
0805 23:06:16.524979 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 23:06:16.526180 20483 raft_consensus.cc:348] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43559 } }
I20260805 23:06:16.526602 20483 raft_consensus.cc:374] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:16.526724 20483 raft_consensus.cc:729] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbf21adc5ae649a9879f7679d65e2d1e, State: Initialized, Role: FOLLOWER
I20260805 23:06:16.527462 20483 consensus_queue.cc:260] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43559 } }
I20260805 23:06:16.527719 20483 raft_consensus.cc:388] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:16.527864 20483 raft_consensus.cc:482] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:16.528025 20483 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:16.530602 20483 raft_consensus.cc:504] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43559 } }
I20260805 23:06:16.531229 20483 leader_election.cc:302] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dbf21adc5ae649a9879f7679d65e2d1e; no voters:
I20260805 23:06:16.531827 20483 leader_election.cc:288] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:16.531971 20499 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:16.532648 20499 raft_consensus.cc:686] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [term 1 LEADER]: Becoming Leader. State: Replica: dbf21adc5ae649a9879f7679d65e2d1e, State: Running, Role: LEADER
I20260805 23:06:16.533227 20499 consensus_queue.cc:237] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43559 } }
I20260805 23:06:16.534044 20483 sys_catalog.cc:564] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:16.536655 20500 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43559 } } }
I20260805 23:06:16.536511 20502 sys_catalog.cc:455] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader dbf21adc5ae649a9879f7679d65e2d1e. Latest consensus state: current_term: 1 leader_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dbf21adc5ae649a9879f7679d65e2d1e" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43559 } } }
I20260805 23:06:16.537019 20502 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:16.537017 20500 sys_catalog.cc:458] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:16.538144 20510 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:16.545789 20510 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:16.555804 20510 catalog_manager.cc:1347] Generated new cluster ID: b63122eebf944deb99ec2bde9d7955ae
I20260805 23:06:16.555955 20510 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:16.575024 20510 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:16.576395 20510 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:16.591890 20510 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dbf21adc5ae649a9879f7679d65e2d1e: Generated new TSK 0
I20260805 23:06:16.592868 20510 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:16.600361 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20387
W20260805 23:06:16.602294 20475 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47361
W20260805 23:06:16.603154 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20387: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:16.603304 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 20387
W20260805 23:06:16.626622 20368 connection.cc:535] client connection to 127.22.45.126:43559 recv error: Network error: failed to read from TLS socket (remote: 127.22.45.126:43559): Connection reset by peer (error 104)
2026-08-05T23:06:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2141 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:16 dist-test-slave-1vmg krb5kdc[20529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:16 dist-test-slave-1vmg krb5kdc[20529](info): set up 2 sockets
Aug 05 23:06:16 dist-test-slave-1vmg krb5kdc[20529](info): commencing operation
krb5kdc: starting...
W20260805 23:06:17.807806 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.007s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:18 dist-test-slave-1vmg krb5kdc[20529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971178, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:18.151172 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:37199
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:36833
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:37199
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:18.520535 20548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:18.520928 20548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:18.521075 20548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:18.528918 20548 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:18.529089 20548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:18.529181 20548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:18.529269 20548 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:18.529332 20548 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:18.540002 20548 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:36833
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:37199
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:37199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:18.541476 20548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:18.542960 20548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:18.555585 20557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:18.555600 20560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:18.556191 20558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:18.556450 20548 server_base.cc:1034] running on GCE node
I20260805 23:06:18.557346 20548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:18.558859 20548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:18.560099 20548 hybrid_clock.cc:648] HybridClock initialized: now 1785971178560053 us; error 42 us; skew 500 ppm
I20260805 23:06:18.560470 20548 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:18 dist-test-slave-1vmg krb5kdc[20529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971178, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:18.563845 20548 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:18.565452 20548 webserver.cc:460] Webserver started at http://127.22.45.126:43375/ using document root <none> and password file <none>
I20260805 23:06:18.566205 20548 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:18.566334 20548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:18.566649 20548 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:18.569921 20548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "11b222b3f60147449bde03e545e345f0"
format_stamp: "Formatted at 2026-08-05 23:06:18 on dist-test-slave-1vmg"
server_key: "f049c4b609c0876bd8dd7d0fb148e018"
server_key_iv: "da6345b323ddf57aae6b8d61a104ae85"
server_key_version: "encryptionkey@0"
I20260805 23:06:18.570721 20548 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "11b222b3f60147449bde03e545e345f0"
format_stamp: "Formatted at 2026-08-05 23:06:18 on dist-test-slave-1vmg"
server_key: "f049c4b609c0876bd8dd7d0fb148e018"
server_key_iv: "da6345b323ddf57aae6b8d61a104ae85"
server_key_version: "encryptionkey@0"
I20260805 23:06:18.576324 20548 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260805 23:06:18.580339 20571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:18.581980 20548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260805 23:06:18.582229 20548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "11b222b3f60147449bde03e545e345f0"
format_stamp: "Formatted at 2026-08-05 23:06:18 on dist-test-slave-1vmg"
server_key: "f049c4b609c0876bd8dd7d0fb148e018"
server_key_iv: "da6345b323ddf57aae6b8d61a104ae85"
server_key_version: "encryptionkey@0"
I20260805 23:06:18.582454 20548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:18.597283 20548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:18.606791 20548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:18.607445 20548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:18.650784 20548 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:37199
I20260805 23:06:18.650868 20640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:37199 every 8 connection(s)
I20260805 23:06:18.654840 20548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:18.657917 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 20548
I20260805 23:06:18.658416 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:18.659508 22709 external_mini_cluster.cc:1428] Setting key da63ee9c23eaad41f2f757259b62ca32
I20260805 23:06:18.668798 20641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:18.684376 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:18.665359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40357 (local address 127.22.45.126:37199)
0805 23:06:18.668383 (+ 3024us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:18.668421 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:18.668537 (+ 116us) server_negotiation.cc:407] Connection header received
0805 23:06:18.673088 (+ 4551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:18.673175 (+ 87us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:18.674084 (+ 909us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:18.675237 (+ 1153us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:18.678498 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:18.678527 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:18.678566 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:18.678606 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:18.678826 (+ 220us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:18.678886 (+ 60us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:18.679980 (+ 1094us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:18.680583 (+ 603us) server_negotiation.cc:299] Negotiation successful
0805 23:06:18.681109 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2271,"thread_start_us":1450,"threads_started":1}
I20260805 23:06:18.696703 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:18.707638 20641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0: Bootstrap starting.
I20260805 23:06:18.722416 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:18.714320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45691 (local address 127.22.45.126:37199)
0805 23:06:18.715225 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:18.715262 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:18.716412 (+ 1150us) server_negotiation.cc:407] Connection header received
0805 23:06:18.716888 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:18.716893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:18.716953 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:18.717183 (+ 230us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:18.720449 (+ 3266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:18.720471 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:18.720488 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:18.720561 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:18.720712 (+ 151us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:18.720759 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:18.721040 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:18.721472 (+ 432us) server_negotiation.cc:299] Negotiation successful
0805 23:06:18.721574 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380}
I20260805 23:06:18.722888 20641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:18.727881 20641 log.cc:824] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:18.737612 20641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0: No bootstrap required, opened a new log
I20260805 23:06:18.757035 20641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b222b3f60147449bde03e545e345f0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 37199 } }
I20260805 23:06:18.757472 20641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:18.757586 20641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b222b3f60147449bde03e545e345f0, State: Initialized, Role: FOLLOWER
I20260805 23:06:18.758185 20641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b222b3f60147449bde03e545e345f0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 37199 } }
I20260805 23:06:18.758423 20641 raft_consensus.cc:388] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:18.758565 20641 raft_consensus.cc:482] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:18.758730 20641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:18.761124 20641 raft_consensus.cc:504] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b222b3f60147449bde03e545e345f0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 37199 } }
I20260805 23:06:18.761703 20641 leader_election.cc:302] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 11b222b3f60147449bde03e545e345f0; no voters:
I20260805 23:06:18.762414 20641 leader_election.cc:288] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:18.762521 20656 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:18.763302 20656 raft_consensus.cc:686] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [term 1 LEADER]: Becoming Leader. State: Replica: 11b222b3f60147449bde03e545e345f0, State: Running, Role: LEADER
I20260805 23:06:18.763947 20656 consensus_queue.cc:237] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b222b3f60147449bde03e545e345f0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 37199 } }
I20260805 23:06:18.765137 20641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:18.766904 20660 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "11b222b3f60147449bde03e545e345f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b222b3f60147449bde03e545e345f0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 37199 } } }
I20260805 23:06:18.767412 20660 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:18.769619 20669 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:18.769299 20659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 11b222b3f60147449bde03e545e345f0. Latest consensus state: current_term: 1 leader_uuid: "11b222b3f60147449bde03e545e345f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "11b222b3f60147449bde03e545e345f0" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 37199 } } }
I20260805 23:06:18.769936 20659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:18.775787 20669 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:18.785450 20669 catalog_manager.cc:1347] Generated new cluster ID: e2f3b51c9a1d41d2a0a2e896f42629d4
I20260805 23:06:18.785609 20669 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:18.800472 20669 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:18.801029 20669 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:18.821314 20669 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 11b222b3f60147449bde03e545e345f0: Generated new TSK 0
I20260805 23:06:18.822460 20669 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:18.841346 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20548
W20260805 23:06:18.842497 20634 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:40357
W20260805 23:06:18.843454 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20548: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:18.843606 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 20548
2026-08-05T23:06:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2245 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:18 dist-test-slave-1vmg krb5kdc[20685](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:18 dist-test-slave-1vmg krb5kdc[20685](info): set up 2 sockets
Aug 05 23:06:18 dist-test-slave-1vmg krb5kdc[20685](info): commencing operation
krb5kdc: starting...
W20260805 23:06:20.066233 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.174s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:20 dist-test-slave-1vmg krb5kdc[20685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:20.402316 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43987
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:39937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:43987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:20.763864 20706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:20.764221 20706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:20.764351 20706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:20.771970 20706 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:20.772119 20706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:20.772205 20706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:20.772302 20706 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:20.772365 20706 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:20.783082 20706 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:39937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:43987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:20.784600 20706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:20.786072 20706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:20.799232 20718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:20.799312 20713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:20.799314 20714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:20.800689 20706 server_base.cc:1034] running on GCE node
I20260805 23:06:20.801586 20706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:20.803264 20706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:20.804504 20706 hybrid_clock.cc:648] HybridClock initialized: now 1785971180804455 us; error 45 us; skew 500 ppm
I20260805 23:06:20.804883 20706 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:20 dist-test-slave-1vmg krb5kdc[20685](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971180, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:20.814743 20706 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:20.816598 20706 webserver.cc:460] Webserver started at http://127.22.45.126:37673/ using document root <none> and password file <none>
I20260805 23:06:20.817397 20706 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:20.817539 20706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:20.817875 20706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:20.821271 20706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "0452c160cec143b1845982a2f31c99ff"
format_stamp: "Formatted at 2026-08-05 23:06:20 on dist-test-slave-1vmg"
server_key: "973afe70cee48b424f3690ea56baae4d"
server_key_iv: "ab47c428c8b074c7487294971c1218e7"
server_key_version: "encryptionkey@0"
I20260805 23:06:20.822335 20706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "0452c160cec143b1845982a2f31c99ff"
format_stamp: "Formatted at 2026-08-05 23:06:20 on dist-test-slave-1vmg"
server_key: "973afe70cee48b424f3690ea56baae4d"
server_key_iv: "ab47c428c8b074c7487294971c1218e7"
server_key_version: "encryptionkey@0"
I20260805 23:06:20.828706 20706 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260805 23:06:20.832769 20727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:20.834311 20706 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 23:06:20.834515 20706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "0452c160cec143b1845982a2f31c99ff"
format_stamp: "Formatted at 2026-08-05 23:06:20 on dist-test-slave-1vmg"
server_key: "973afe70cee48b424f3690ea56baae4d"
server_key_iv: "ab47c428c8b074c7487294971c1218e7"
server_key_version: "encryptionkey@0"
I20260805 23:06:20.834733 20706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:20.850693 20706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:20.855238 20706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:20.855537 20706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:20.874145 20706 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:43987
I20260805 23:06:20.874176 20796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:43987 every 8 connection(s)
I20260805 23:06:20.875650 20706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:20.877383 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 20706
I20260805 23:06:20.877564 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:20.878124 22709 external_mini_cluster.cc:1428] Setting key bd10d45ae4cea168651cbac07c908467
I20260805 23:06:20.880400 20797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 05 23:06:20 dist-test-slave-1vmg krb5kdc[20685](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971180, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:20.893873 20797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff: Bootstrap starting.
I20260805 23:06:20.898375 20797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:20.899710 20797 log.cc:824] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:20.902866 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:20.880036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55201 (local address 127.22.45.126:43987)
0805 23:06:20.880809 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:20.880821 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:20.880862 (+ 41us) server_negotiation.cc:407] Connection header received
0805 23:06:20.882468 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:20.882489 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:20.882881 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:20.883282 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:20.885044 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:20.886431 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:20.888257 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:20.888958 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:20.889095 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:20.894041 (+ 4946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:20.894055 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:20.894078 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:20.894129 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:20.898079 (+ 3950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:20.898896 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:20.898905 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:20.898936 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:20.899163 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:20.899530 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:20.899535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:20.899538 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:20.900336 (+ 798us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:20.900631 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:20.901102 (+ 471us) server_negotiation.cc:299] Negotiation successful
0805 23:06:20.901528 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":565,"thread_start_us":350,"threads_started":1}
I20260805 23:06:20.903503 20797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff: No bootstrap required, opened a new log
I20260805 23:06:20.906755 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:20.913446 20797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0452c160cec143b1845982a2f31c99ff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43987 } }
I20260805 23:06:20.913962 20797 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:20.914080 20797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0452c160cec143b1845982a2f31c99ff, State: Initialized, Role: FOLLOWER
I20260805 23:06:20.914743 20797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0452c160cec143b1845982a2f31c99ff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43987 } }
I20260805 23:06:20.915031 20797 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:20.915190 20797 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:20.915410 20797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:20.918355 20797 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0452c160cec143b1845982a2f31c99ff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43987 } }
I20260805 23:06:20.919108 20797 leader_election.cc:302] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0452c160cec143b1845982a2f31c99ff; no voters:
I20260805 23:06:20.919836 20797 leader_election.cc:288] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:20.920019 20815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:20.921079 20815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [term 1 LEADER]: Becoming Leader. State: Replica: 0452c160cec143b1845982a2f31c99ff, State: Running, Role: LEADER
I20260805 23:06:20.921799 20815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0452c160cec143b1845982a2f31c99ff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43987 } }
I20260805 23:06:20.922328 20797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:20.924759 20816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0452c160cec143b1845982a2f31c99ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0452c160cec143b1845982a2f31c99ff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43987 } } }
I20260805 23:06:20.925189 20816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:20.928263 20822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:20.928196 20818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0452c160cec143b1845982a2f31c99ff. Latest consensus state: current_term: 1 leader_uuid: "0452c160cec143b1845982a2f31c99ff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0452c160cec143b1845982a2f31c99ff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43987 } } }
I20260805 23:06:20.928607 20818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:20.930823 20801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:20.912456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50367 (local address 127.22.45.126:43987)
0805 23:06:20.912668 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:20.912674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:20.913146 (+ 472us) server_negotiation.cc:407] Connection header received
0805 23:06:20.913300 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:20.913306 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:20.913390 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:20.913520 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:20.915326 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:20.916440 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:20.917734 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:20.918373 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:20.918511 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:20.921779 (+ 3268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:20.921790 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:20.921795 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:20.921843 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:20.926053 (+ 4210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:20.927710 (+ 1657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:20.927717 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:20.927724 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:20.927990 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:20.928522 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:20.928527 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:20.928530 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:20.928946 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:20.929309 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:20.930339 (+ 1030us) server_negotiation.cc:299] Negotiation successful
0805 23:06:20.930554 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260805 23:06:20.935676 20822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:20.950372 20822 catalog_manager.cc:1347] Generated new cluster ID: fe7a4e91de494fe9aa69b8bcb6772cdf
I20260805 23:06:20.950542 20822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:20.962762 20822 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:20.964836 20822 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:20.980058 20822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0452c160cec143b1845982a2f31c99ff: Generated new TSK 0
I20260805 23:06:20.981580 20822 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:21.000629 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20706
I20260805 23:06:21.002548 20791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:21.100593 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 20706
2026-08-05T23:06:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2251 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:21 dist-test-slave-1vmg krb5kdc[20848](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:21 dist-test-slave-1vmg krb5kdc[20848](info): set up 2 sockets
Aug 05 23:06:21 dist-test-slave-1vmg krb5kdc[20848](info): commencing operation
krb5kdc: starting...
W20260805 23:06:22.315372 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.172s user 0.003s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:22 dist-test-slave-1vmg krb5kdc[20848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:22.655160 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:40639
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:44735
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:40639
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:23.024148 20866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:23.024514 20866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:23.024626 20866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:23.032333 20866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:23.032485 20866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:23.032532 20866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:23.032605 20866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:23.032672 20866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:23.043337 20866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:44735
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:40639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:40639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:23.044840 20866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:23.046290 20866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:23.059463 20871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:23.059478 20872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:23.059428 20876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:23.060496 20866 server_base.cc:1034] running on GCE node
I20260805 23:06:23.061424 20866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:23.063086 20866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:23.064303 20866 hybrid_clock.cc:648] HybridClock initialized: now 1785971183064255 us; error 41 us; skew 500 ppm
I20260805 23:06:23.064654 20866 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:23 dist-test-slave-1vmg krb5kdc[20848](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971183, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:23.067950 20866 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:23.069751 20866 webserver.cc:460] Webserver started at http://127.22.45.126:39913/ using document root <none> and password file <none>
I20260805 23:06:23.070533 20866 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:23.070657 20866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:23.071061 20866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:23.074466 20866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "88424ab1663a42c2b018e7a7d628f518"
format_stamp: "Formatted at 2026-08-05 23:06:23 on dist-test-slave-1vmg"
server_key: "66ff3243767874f34964448307bb66e0"
server_key_iv: "be73093670de63af62ab8e135d7b04bd"
server_key_version: "encryptionkey@0"
I20260805 23:06:23.075395 20866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "88424ab1663a42c2b018e7a7d628f518"
format_stamp: "Formatted at 2026-08-05 23:06:23 on dist-test-slave-1vmg"
server_key: "66ff3243767874f34964448307bb66e0"
server_key_iv: "be73093670de63af62ab8e135d7b04bd"
server_key_version: "encryptionkey@0"
I20260805 23:06:23.082581 20866 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260805 23:06:23.087054 20885 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:23.088689 20866 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:06:23.088928 20866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "88424ab1663a42c2b018e7a7d628f518"
format_stamp: "Formatted at 2026-08-05 23:06:23 on dist-test-slave-1vmg"
server_key: "66ff3243767874f34964448307bb66e0"
server_key_iv: "be73093670de63af62ab8e135d7b04bd"
server_key_version: "encryptionkey@0"
I20260805 23:06:23.089159 20866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:23.104164 20866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:23.108639 20866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:23.108922 20866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:23.129722 20866 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:40639
I20260805 23:06:23.129722 20956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:40639 every 8 connection(s)
I20260805 23:06:23.131383 20866 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:23.135650 20958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:23.140192 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 20866
I20260805 23:06:23.140362 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:23.140797 22709 external_mini_cluster.cc:1428] Setting key 4cd518695c525ed9634e6ea92d914cca
I20260805 23:06:23.150233 20958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518: Bootstrap starting.
I20260805 23:06:23.155087 20958 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:23.155853 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:23.142765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57469 (local address 127.22.45.126:40639)
0805 23:06:23.143739 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:23.143753 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:23.143798 (+ 45us) server_negotiation.cc:407] Connection header received
0805 23:06:23.145523 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:23.145551 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:23.146071 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:23.146530 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:23.147227 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:23.148658 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:23.150110 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:23.150962 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:23.151158 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:23.152690 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:23.152701 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:23.152721 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:23.153383 (+ 662us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:23.153476 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:23.153507 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:23.153632 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:23.153897 (+ 265us) server_negotiation.cc:299] Negotiation successful
0805 23:06:23.154208 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":739,"thread_start_us":497,"threads_started":1}
I20260805 23:06:23.156600 20958 log.cc:824] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:23.160485 20958 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518: No bootstrap required, opened a new log
I20260805 23:06:23.160872 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:23.169979 20958 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88424ab1663a42c2b018e7a7d628f518" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40639 } }
I20260805 23:06:23.170518 20958 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:23.170637 20958 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88424ab1663a42c2b018e7a7d628f518, State: Initialized, Role: FOLLOWER
I20260805 23:06:23.171453 20958 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88424ab1663a42c2b018e7a7d628f518" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40639 } }
I20260805 23:06:23.171736 20958 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:23.171900 20958 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:23.172106 20958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:23.173293 20962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:23.165700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60815 (local address 127.22.45.126:40639)
0805 23:06:23.165902 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:23.165909 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:23.166460 (+ 551us) server_negotiation.cc:407] Connection header received
0805 23:06:23.166676 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:23.166681 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:23.166755 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:23.166849 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:23.167482 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:23.168253 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:23.170016 (+ 1763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:23.170809 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:23.171019 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:23.172486 (+ 1467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:23.172491 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:23.172494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:23.172517 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:23.172572 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:23.172590 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:23.172674 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:23.172836 (+ 162us) server_negotiation.cc:299] Negotiation successful
0805 23:06:23.172952 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260805 23:06:23.175041 20958 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88424ab1663a42c2b018e7a7d628f518" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40639 } }
I20260805 23:06:23.175642 20958 leader_election.cc:302] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88424ab1663a42c2b018e7a7d628f518; no voters:
I20260805 23:06:23.176273 20958 leader_election.cc:288] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:23.176442 20971 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:23.177289 20971 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [term 1 LEADER]: Becoming Leader. State: Replica: 88424ab1663a42c2b018e7a7d628f518, State: Running, Role: LEADER
I20260805 23:06:23.177929 20971 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88424ab1663a42c2b018e7a7d628f518" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40639 } }
I20260805 23:06:23.178737 20958 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:23.181283 20974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88424ab1663a42c2b018e7a7d628f518. Latest consensus state: current_term: 1 leader_uuid: "88424ab1663a42c2b018e7a7d628f518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88424ab1663a42c2b018e7a7d628f518" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40639 } } }
I20260805 23:06:23.181277 20973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88424ab1663a42c2b018e7a7d628f518" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88424ab1663a42c2b018e7a7d628f518" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 40639 } } }
I20260805 23:06:23.181802 20974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:23.181820 20973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:23.182739 20980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:23.190346 20980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:23.206480 20980 catalog_manager.cc:1347] Generated new cluster ID: 733f06fbd95a40a1a7218d503b1ced31
I20260805 23:06:23.206655 20980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:23.224821 20980 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:23.226866 20980 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:23.249027 20980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88424ab1663a42c2b018e7a7d628f518: Generated new TSK 0
I20260805 23:06:23.250067 20980 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:23.256493 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20866
W20260805 23:06:23.257805 20950 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57469
W20260805 23:06:23.258672 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 20866: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:23.258857 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 20866
2026-08-05T23:06:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2158 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:23 dist-test-slave-1vmg krb5kdc[20998](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:23 dist-test-slave-1vmg krb5kdc[20998](info): set up 2 sockets
Aug 05 23:06:23 dist-test-slave-1vmg krb5kdc[20998](info): commencing operation
krb5kdc: starting...
W20260805 23:06:24.477408 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.175s user 0.000s sys 0.049s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:24 dist-test-slave-1vmg krb5kdc[20998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971184, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:24.822499 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35559
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:40241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:35559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:25.190119 21023 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:25.190644 21023 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:25.190798 21023 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:25.199054 21023 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:25.199213 21023 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:25.199262 21023 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:25.199326 21023 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:25.199370 21023 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:25.212136 21023 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:40241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:35559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:35559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:25.213627 21023 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:25.215116 21023 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:25.228662 21032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:25.228729 21036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:25.228705 21031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:25.229628 21023 server_base.cc:1034] running on GCE node
I20260805 23:06:25.230549 21023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:25.232211 21023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:25.233475 21023 hybrid_clock.cc:648] HybridClock initialized: now 1785971185233411 us; error 64 us; skew 500 ppm
I20260805 23:06:25.233892 21023 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:25 dist-test-slave-1vmg krb5kdc[20998](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971185, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:25.237529 21023 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:25.239413 21023 webserver.cc:460] Webserver started at http://127.22.45.126:40899/ using document root <none> and password file <none>
I20260805 23:06:25.240300 21023 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:25.240466 21023 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:25.240831 21023 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:25.244410 21023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "5a7ff827740742f695c9044fddc7be38"
format_stamp: "Formatted at 2026-08-05 23:06:25 on dist-test-slave-1vmg"
server_key: "97433240acec2aa68152d0a36a809b26"
server_key_iv: "872cf6aec6a2f422db0d25f32e55b779"
server_key_version: "encryptionkey@0"
I20260805 23:06:25.245354 21023 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "5a7ff827740742f695c9044fddc7be38"
format_stamp: "Formatted at 2026-08-05 23:06:25 on dist-test-slave-1vmg"
server_key: "97433240acec2aa68152d0a36a809b26"
server_key_iv: "872cf6aec6a2f422db0d25f32e55b779"
server_key_version: "encryptionkey@0"
I20260805 23:06:25.251999 21023 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260805 23:06:25.256333 21047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:25.257889 21023 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260805 23:06:25.258093 21023 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "5a7ff827740742f695c9044fddc7be38"
format_stamp: "Formatted at 2026-08-05 23:06:25 on dist-test-slave-1vmg"
server_key: "97433240acec2aa68152d0a36a809b26"
server_key_iv: "872cf6aec6a2f422db0d25f32e55b779"
server_key_version: "encryptionkey@0"
I20260805 23:06:25.258325 21023 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:25.265115 21023 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:25.270109 21023 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:25.270474 21023 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:25.290685 21023 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:35559
I20260805 23:06:25.290724 21121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:35559 every 8 connection(s)
I20260805 23:06:25.292305 21023 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:25.296521 21122 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:25.297394 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 21023
I20260805 23:06:25.297605 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:25.298169 22709 external_mini_cluster.cc:1428] Setting key bd69186a86c6008cab78fa8940aab10c
I20260805 23:06:25.308143 21126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:25.301135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46167 (local address 127.22.45.126:35559)
0805 23:06:25.302172 (+ 1037us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:25.302187 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:25.302247 (+ 60us) server_negotiation.cc:407] Connection header received
0805 23:06:25.304075 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:25.304109 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:25.304591 (+ 482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:25.305008 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:25.306310 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:25.306318 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:25.306333 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:25.306351 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:25.306423 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:25.306449 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:25.306652 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:25.306760 (+ 108us) server_negotiation.cc:299] Negotiation successful
0805 23:06:25.307009 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":465,"threads_started":1}
I20260805 23:06:25.312037 21122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38: Bootstrap starting.
I20260805 23:06:25.312341 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:25.315657 21122 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:25.316972 21122 log.cc:824] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:25.319777 21126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:25.317024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44827 (local address 127.22.45.126:35559)
0805 23:06:25.317240 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:25.317246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:25.317649 (+ 403us) server_negotiation.cc:407] Connection header received
0805 23:06:25.317908 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:25.317914 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:25.317995 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:25.318124 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:25.319104 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:25.319109 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:25.319114 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0805 23:06:25.319135 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:25.319189 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0805 23:06:25.319209 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:25.319344 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:25.319393 (+ 49us) server_negotiation.cc:299] Negotiation successful
0805 23:06:25.319459 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260805 23:06:25.321187 21122 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38: No bootstrap required, opened a new log
I20260805 23:06:25.331067 21122 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7ff827740742f695c9044fddc7be38" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35559 } }
I20260805 23:06:25.331669 21122 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260805 23:06:25.331791 21122 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a7ff827740742f695c9044fddc7be38, State: Initialized, Role: FOLLOWER
I20260805 23:06:25.332517 21122 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7ff827740742f695c9044fddc7be38" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35559 } }
I20260805 23:06:25.332779 21122 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260805 23:06:25.332891 21122 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260805 23:06:25.333024 21122 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:25.335568 21122 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7ff827740742f695c9044fddc7be38" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35559 } }
I20260805 23:06:25.336190 21122 leader_election.cc:302] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a7ff827740742f695c9044fddc7be38; no voters:
I20260805 23:06:25.336797 21122 leader_election.cc:288] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260805 23:06:25.336949 21137 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:25.337628 21137 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [term 1 LEADER]: Becoming Leader. State: Replica: 5a7ff827740742f695c9044fddc7be38, State: Running, Role: LEADER
I20260805 23:06:25.338191 21137 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7ff827740742f695c9044fddc7be38" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35559 } }
I20260805 23:06:25.339016 21122 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:25.341409 21138 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a7ff827740742f695c9044fddc7be38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7ff827740742f695c9044fddc7be38" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35559 } } }
I20260805 23:06:25.341902 21138 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:25.342389 21139 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a7ff827740742f695c9044fddc7be38. Latest consensus state: current_term: 1 leader_uuid: "5a7ff827740742f695c9044fddc7be38" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a7ff827740742f695c9044fddc7be38" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 35559 } } }
I20260805 23:06:25.342718 21139 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:25.347669 21147 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:25.354031 21147 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:25.364969 21147 catalog_manager.cc:1347] Generated new cluster ID: 4aa3344731864348b4af7ff8e1c845b5
I20260805 23:06:25.365114 21147 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:25.380631 21147 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:25.381134 21147 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:25.390414 21147 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5a7ff827740742f695c9044fddc7be38: Generated new TSK 0
I20260805 23:06:25.391409 21147 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:25.407280 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21023
W20260805 23:06:25.408504 21115 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46167
W20260805 23:06:25.409276 22709 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21023: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260805 23:06:25.409440 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 21023
2026-08-05T23:06:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2151 ms)
[----------] 18 tests from AuthTokenIssuingTest (39514 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:25 dist-test-slave-1vmg krb5kdc[21165](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:25 dist-test-slave-1vmg krb5kdc[21165](info): set up 2 sockets
Aug 05 23:06:25 dist-test-slave-1vmg krb5kdc[21165](info): commencing operation
krb5kdc: starting...
W20260805 23:06:26.633111 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.179s user 0.003s sys 0.047s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:26 dist-test-slave-1vmg krb5kdc[21165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:26.978847 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43857
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:43857,127.22.45.125:32881,127.22.45.124:46275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:27.350458 21178 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 23:06:27.350876 21178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:27.350999 21178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:27.351135 21178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:27.359025 21178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:27.359146 21178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:27.359225 21178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:27.359302 21178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:27.359395 21178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:27.370071 21178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:43857,127.22.45.125:32881,127.22.45.124:46275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:43857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:27.371625 21178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:27.373008 21178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:27.384938 21184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:27.384909 21188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:27.384974 21185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:27.385720 21178 server_base.cc:1034] running on GCE node
I20260805 23:06:27.386570 21178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:27.388124 21178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:27.389372 21178 hybrid_clock.cc:648] HybridClock initialized: now 1785971187389306 us; error 40 us; skew 500 ppm
I20260805 23:06:27.389726 21178 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:27 dist-test-slave-1vmg krb5kdc[21165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:27.395790 21178 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:27.397497 21178 webserver.cc:460] Webserver started at http://127.22.45.126:39645/ using document root <none> and password file <none>
I20260805 23:06:27.398253 21178 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:27.398355 21178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:27.398648 21178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:27.401950 21178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "1aba2247294e481eac89e42015ef8d25"
format_stamp: "Formatted at 2026-08-05 23:06:27 on dist-test-slave-1vmg"
server_key: "5183f04c6a439d02916e5fe0cb4c1977"
server_key_iv: "dcbda4ded0e3afa94542373794ac4a2e"
server_key_version: "encryptionkey@0"
I20260805 23:06:27.402798 21178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "1aba2247294e481eac89e42015ef8d25"
format_stamp: "Formatted at 2026-08-05 23:06:27 on dist-test-slave-1vmg"
server_key: "5183f04c6a439d02916e5fe0cb4c1977"
server_key_iv: "dcbda4ded0e3afa94542373794ac4a2e"
server_key_version: "encryptionkey@0"
I20260805 23:06:27.408644 21178 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260805 23:06:27.412801 21200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:27.414496 21178 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260805 23:06:27.414700 21178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "1aba2247294e481eac89e42015ef8d25"
format_stamp: "Formatted at 2026-08-05 23:06:27 on dist-test-slave-1vmg"
server_key: "5183f04c6a439d02916e5fe0cb4c1977"
server_key_iv: "dcbda4ded0e3afa94542373794ac4a2e"
server_key_version: "encryptionkey@0"
I20260805 23:06:27.414992 21178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:27.445505 21178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:27.450416 21178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:27.450712 21178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:27.468874 21178 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:43857
I20260805 23:06:27.468883 21273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:43857 every 8 connection(s)
I20260805 23:06:27.470373 21178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:27.474473 21275 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:27.475103 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 21178
I20260805 23:06:27.475308 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:27.475945 22709 external_mini_cluster.cc:1428] Setting key 7ba9da664069b728bb4475cae166335d
I20260805 23:06:27.482103 21275 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:27 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:27.506754 21280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.485770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58052 (local address 127.22.45.126:43857)
0805 23:06:27.487710 (+ 1940us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:27.487718 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:27.487782 (+ 64us) server_negotiation.cc:407] Connection header received
0805 23:06:27.489515 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:27.489522 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:27.489797 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:27.489989 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:27.491480 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:27.492728 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:27.494313 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:27.494907 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:27.495133 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:27.499482 (+ 4349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:27.499491 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:27.499506 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:27.499537 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:27.502296 (+ 2759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:27.503208 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:27.503227 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:27.503230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:27.503421 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:27.503892 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:27.503895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:27.503897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:27.504444 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:27.504609 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:27.505327 (+ 718us) server_negotiation.cc:299] Negotiation successful
0805 23:06:27.505626 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1715,"thread_start_us":1469,"threads_started":1}
I20260805 23:06:27.506820 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.485769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:43857 (local address 127.0.0.1:58052)
0805 23:06:27.486761 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.486817 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:27.489080 (+ 2263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:27.490039 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:27.490045 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:27.490844 (+ 799us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:27.491256 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:27.491276 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:27.492899 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:27.492903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:27.494167 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:27.494181 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:27.495318 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:27.495331 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:27.495545 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:27.496306 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:27.496336 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:27.499229 (+ 2893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:27.502445 (+ 3216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:27.502457 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:27.502471 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:27.503053 (+ 582us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:27.503543 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:27.503549 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:27.503552 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:27.503782 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:27.504598 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:27.504607 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:27.504895 (+ 288us) client_negotiation.cc:769] Sending connection context
0805 23:06:27.505193 (+ 298us) client_negotiation.cc:240] Negotiation successful
0805 23:06:27.505847 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":83,"thread_start_us":397,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.125@KRBTEST.COM" created.
I20260805 23:06:27.510089 21275 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:06:27.511420 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.510965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34188)
0805 23:06:27.511153 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.511285 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 23:06:27.511722 21204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
I20260805 23:06:27.513513 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.513084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34190)
0805 23:06:27.513277 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.513356 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260805 23:06:27.513752 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:32881: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab.
Entry for principal kudu/127.22.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab.
I20260805 23:06:27.547516 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:32881
--webserver_interface=127.22.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab
--principal=kudu/127.22.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:43857,127.22.45.125:32881,127.22.45.124:46275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:06:27.563151 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } attempt: 1
I20260805 23:06:27.564517 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.563974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34200)
0805 23:06:27.564202 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.564340 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 23:06:27.565645 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.565209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34214)
0805 23:06:27.565380 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.565471 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260805 23:06:27.565855 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:32881: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
I20260805 23:06:27.634160 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } attempt: 2
I20260805 23:06:27.635628 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.634984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34224)
0805 23:06:27.635286 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.635412 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260805 23:06:27.636826 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.636311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34228)
0805 23:06:27.636491 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.636616 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260805 23:06:27.637042 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:32881: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
I20260805 23:06:27.728381 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } attempt: 3
I20260805 23:06:27.729724 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.729183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34236)
0805 23:06:27.729427 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.729543 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260805 23:06:27.730858 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.730405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34240)
0805 23:06:27.730582 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.730680 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260805 23:06:27.731141 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:32881: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
I20260805 23:06:27.874476 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } attempt: 4
I20260805 23:06:27.875969 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.875270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34254)
0805 23:06:27.875655 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.875776 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193}
I20260805 23:06:27.877197 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:27.876716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34266)
0805 23:06:27.876898 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:27.877020 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260805 23:06:27.877421 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:32881: Network error: Client connection negotiation failed: client connection to 127.22.45.125:32881: connect: Connection refused (error 111)
W20260805 23:06:27.908561 21287 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 23:06:27.908972 21287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:27.909050 21287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:27.909154 21287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:27.917171 21287 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:27.917306 21287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:27.917367 21287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:27.917420 21287 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:27.917493 21287 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:27.928128 21287 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:43857,127.22.45.125:32881,127.22.45.124:46275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab
--principal=kudu/127.22.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:32881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:27.929512 21287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:27.930987 21287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:27.943183 21294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:27.943228 21296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:27.943274 21300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:27.944367 21287 server_base.cc:1034] running on GCE node
I20260805 23:06:27.945218 21287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:27.946789 21287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:27.948038 21287 hybrid_clock.cc:648] HybridClock initialized: now 1785971187947986 us; error 58 us; skew 500 ppm
I20260805 23:06:27.948405 21287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:27 dist-test-slave-1vmg krb5kdc[21165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:27.951874 21287 init.cc:377] Logged in from keytab as kudu/127.22.45.125@KRBTEST.COM (short username kudu)
I20260805 23:06:27.953588 21287 webserver.cc:460] Webserver started at http://127.22.45.125:37265/ using document root <none> and password file <none>
I20260805 23:06:27.954366 21287 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:27.954483 21287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:27.954845 21287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:27.958288 21287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data/instance:
uuid: "de2a75bae7894a9cbfe434e0cd0092e9"
format_stamp: "Formatted at 2026-08-05 23:06:27 on dist-test-slave-1vmg"
server_key: "395eb8ee13c04e4514de89663de33502"
server_key_iv: "fb373f9a26e2808195ddec8172d70c7e"
server_key_version: "encryptionkey@0"
I20260805 23:06:27.959291 21287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/wal/instance:
uuid: "de2a75bae7894a9cbfe434e0cd0092e9"
format_stamp: "Formatted at 2026-08-05 23:06:27 on dist-test-slave-1vmg"
server_key: "395eb8ee13c04e4514de89663de33502"
server_key_iv: "fb373f9a26e2808195ddec8172d70c7e"
server_key_version: "encryptionkey@0"
I20260805 23:06:27.965412 21287 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:06:27.969817 21309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:27.971443 21287 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:06:27.971637 21287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/wal
uuid: "de2a75bae7894a9cbfe434e0cd0092e9"
format_stamp: "Formatted at 2026-08-05 23:06:27 on dist-test-slave-1vmg"
server_key: "395eb8ee13c04e4514de89663de33502"
server_key_iv: "fb373f9a26e2808195ddec8172d70c7e"
server_key_version: "encryptionkey@0"
I20260805 23:06:27.971889 21287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:28.000447 21287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:28.005226 21287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:28.005532 21287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:28.026090 21287 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.125:32881
I20260805 23:06:28.026119 21376 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.125:32881 every 8 connection(s)
I20260805 23:06:28.027781 21287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
I20260805 23:06:28.031991 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 21287
I20260805 23:06:28.032096 21377 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:28.032182 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-1/wal/instance
I20260805 23:06:28.032612 22709 external_mini_cluster.cc:1428] Setting key 137492c439ea646f3ef4a34c17c91f28
I20260805 23:06:28.039646 21377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:28.065505 21379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.042738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58056 (local address 127.22.45.126:43857)
0805 23:06:28.043331 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.043337 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.044451 (+ 1114us) server_negotiation.cc:407] Connection header received
0805 23:06:28.046683 (+ 2232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.046688 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.046791 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.046900 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.049419 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.050148 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.052596 (+ 2448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.053080 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.053197 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.058392 (+ 5195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.058398 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.058402 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.058458 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.061438 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.062725 (+ 1287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.062731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.062733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.062887 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.063495 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.063499 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.063500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.063825 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.063952 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.065008 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.065226 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":297,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.124@KRBTEST.COM; defaulting to no policy
I20260805 23:06:28.067234 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.043357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:43857 (local address 127.0.0.1:58056)
0805 23:06:28.044228 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.044293 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.046320 (+ 2027us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.047259 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.047273 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.048167 (+ 894us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.049095 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.049128 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.050367 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.050373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.052389 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.052414 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.053368 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.053375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.053678 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.054620 (+ 942us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.054651 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.058012 (+ 3361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.061687 (+ 3675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.061699 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.061724 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.062542 (+ 818us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.063048 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.063054 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.063057 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.063374 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.063976 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.063987 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.064539 (+ 552us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.064913 (+ 374us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.065558 (+ 645us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":359,"threads_started":1}
I20260805 23:06:28.069500 21377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.124@KRBTEST.COM" created.
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:06:28.085487 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.070426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34274)
0805 23:06:28.070647 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.070664 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.070773 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.071848 (+ 1075us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.071853 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.072323 (+ 470us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.072467 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.072476 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.073943 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.073947 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.074815 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.074829 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.075846 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.075852 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.076035 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.076729 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.076748 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.079040 (+ 2292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.082690 (+ 3650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.082694 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.082697 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.083182 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.083633 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.083637 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.083639 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.083784 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.084479 (+ 695us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.084483 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.084640 (+ 157us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.084765 (+ 125us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.085094 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
I20260805 23:06:28.085618 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.070651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34274 (local address 127.22.45.125:32881)
0805 23:06:28.071388 (+ 737us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.071395 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.071422 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:06:28.071477 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.071483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.071687 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.071837 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.072651 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.073792 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.075000 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.075651 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.075796 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.079295 (+ 3499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.079312 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.079329 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.079364 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.082474 (+ 3110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.083348 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.083358 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.083360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.083501 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.083895 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.083900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.083902 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.084320 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.084548 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.084926 (+ 378us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.085234 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":582,"thread_start_us":434,"threads_started":1}
I20260805 23:06:28.088580 21377 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:06:28.089916 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.089383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42738)
0805 23:06:28.089586 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.089751 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260805 23:06:28.090243 21311 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.092119 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.091722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42746)
0805 23:06:28.091897 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.091990 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260805 23:06:28.092384 21377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab.
Entry for principal kudu/127.22.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab.
I20260805 23:06:28.110446 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:46275
--webserver_interface=127.22.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab
--principal=kudu/127.22.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:45273
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:43857,127.22.45.125:32881,127.22.45.124:46275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:06:28.141765 21377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 1
I20260805 23:06:28.143244 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.142687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42752)
0805 23:06:28.142900 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.143060 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 23:06:28.144711 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.144010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42762)
0805 23:06:28.144350 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.144519 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
W20260805 23:06:28.145119 21377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.176692 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } attempt: 5
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:06:28.194283 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.177807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34288 (local address 127.22.45.125:32881)
0805 23:06:28.178056 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.178063 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.178127 (+ 64us) server_negotiation.cc:407] Connection header received
0805 23:06:28.178348 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.178354 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.178446 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.178617 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.179715 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.180843 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.182290 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.183098 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.183264 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.187849 (+ 4585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.187857 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.187861 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.187916 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.191009 (+ 3093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.192043 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.192048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.192051 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.192219 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.192724 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.192729 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.192731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.193090 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.193224 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.193814 (+ 590us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.194024 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 23:06:28.194356 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.177676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34288)
0805 23:06:28.178017 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.178044 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.178205 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.178755 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.178762 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.179297 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.179514 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.179528 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.181043 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.181048 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.182078 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.182098 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.183386 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.183393 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.183650 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.184398 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.184420 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.187452 (+ 3032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.191218 (+ 3766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.191225 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.191229 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.191871 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.192345 (+ 474us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.192350 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.192353 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.192544 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.193230 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.193235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.193442 (+ 207us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.193660 (+ 218us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.193996 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260805 23:06:28.195799 21275 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:06:28.197064 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.196607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42778)
0805 23:06:28.196807 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.196899 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260805 23:06:28.198186 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.197829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42780)
0805 23:06:28.197975 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.198056 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260805 23:06:28.198397 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.213392 21377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 2
I20260805 23:06:28.214712 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.214196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42790)
0805 23:06:28.214436 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.214540 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260805 23:06:28.216078 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.215453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42800)
0805 23:06:28.215694 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.215902 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260805 23:06:28.216683 21377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.249660 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 1
I20260805 23:06:28.251133 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.250503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42816)
0805 23:06:28.250776 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.250881 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260805 23:06:28.252252 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.251877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42820)
0805 23:06:28.252041 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.252121 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260805 23:06:28.252506 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.307950 21377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 3
I20260805 23:06:28.309144 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.308700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42824)
0805 23:06:28.308891 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.308983 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260805 23:06:28.310204 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.309798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42826)
0805 23:06:28.310017 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.310096 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
W20260805 23:06:28.310412 21377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.320730 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 2
I20260805 23:06:28.321837 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.321362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42836)
0805 23:06:28.321573 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.321662 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260805 23:06:28.322813 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.322486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42850)
0805 23:06:28.322628 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.322707 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260805 23:06:28.323045 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.429272 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 3
I20260805 23:06:28.430449 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.429991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42862)
0805 23:06:28.430189 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.430279 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260805 23:06:28.431517 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.431093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42866)
0805 23:06:28.431331 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.431418 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
W20260805 23:06:28.431718 21275 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
I20260805 23:06:28.453626 21377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 4
I20260805 23:06:28.454802 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.454304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42880)
0805 23:06:28.454534 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.454625 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260805 23:06:28.455921 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.455550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42892)
0805 23:06:28.455715 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.455793 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260805 23:06:28.456140 21377 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:46275: Network error: Client connection negotiation failed: client connection to 127.22.45.124:46275: connect: Connection refused (error 111)
W20260805 23:06:28.486207 21388 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 23:06:28.486629 21388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:28.486738 21388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:28.486856 21388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:28.494753 21388 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:28.494885 21388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:28.495000 21388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:28.495072 21388 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:28.495162 21388 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:28.505903 21388 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:45273
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:43857,127.22.45.125:32881,127.22.45.124:46275
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab
--principal=kudu/127.22.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:46275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:28.507432 21388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:28.508913 21388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:28.521401 21396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:28.521404 21395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:28.521433 21398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:28.522289 21388 server_base.cc:1034] running on GCE node
I20260805 23:06:28.523191 21388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:28.524806 21388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:28.526041 21388 hybrid_clock.cc:648] HybridClock initialized: now 1785971188525969 us; error 45 us; skew 500 ppm
I20260805 23:06:28.526400 21388 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971188, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:28.529973 21388 init.cc:377] Logged in from keytab as kudu/127.22.45.124@KRBTEST.COM (short username kudu)
I20260805 23:06:28.531620 21388 webserver.cc:460] Webserver started at http://127.22.45.124:43971/ using document root <none> and password file <none>
I20260805 23:06:28.532375 21388 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:28.532473 21388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:28.532768 21388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:28.536136 21388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data/instance:
uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760"
format_stamp: "Formatted at 2026-08-05 23:06:28 on dist-test-slave-1vmg"
server_key: "38320c6758031b6a76174606f8d304de"
server_key_iv: "947d40c210ff58dd5cb3b2d2d6fe05c5"
server_key_version: "encryptionkey@0"
I20260805 23:06:28.537017 21388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/wal/instance:
uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760"
format_stamp: "Formatted at 2026-08-05 23:06:28 on dist-test-slave-1vmg"
server_key: "38320c6758031b6a76174606f8d304de"
server_key_iv: "947d40c210ff58dd5cb3b2d2d6fe05c5"
server_key_version: "encryptionkey@0"
I20260805 23:06:28.542788 21388 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260805 23:06:28.546563 21408 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:28.548105 21388 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:06:28.548274 21388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/wal
uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760"
format_stamp: "Formatted at 2026-08-05 23:06:28 on dist-test-slave-1vmg"
server_key: "38320c6758031b6a76174606f8d304de"
server_key_iv: "947d40c210ff58dd5cb3b2d2d6fe05c5"
server_key_version: "encryptionkey@0"
I20260805 23:06:28.548482 21388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:28.581831 21388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:28.586315 21388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:28.586578 21388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:28.605922 21388 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.124:46275
I20260805 23:06:28.605939 21493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.124:46275 every 8 connection(s)
I20260805 23:06:28.607508 21388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
I20260805 23:06:28.608945 21275 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 4
I20260805 23:06:28.612605 21495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:28.615418 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 21388
I20260805 23:06:28.615625 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1785970804553337-22709-0/minicluster-data/master-2/wal/instance
I20260805 23:06:28.616185 22709 external_mini_cluster.cc:1428] Setting key 1218264d722931405c3d6c2cd2f92ef4
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
I20260805 23:06:28.622841 21495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
I20260805 23:06:28.633102 21278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.609732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42906)
0805 23:06:28.609954 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.609976 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.610095 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.614540 (+ 4445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.614546 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.615167 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.615339 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.615351 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.618341 (+ 2990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.618349 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.619744 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.619768 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.621282 (+ 1514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.621290 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.621491 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.622289 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.622314 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.624558 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.628945 (+ 4387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.628953 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.628958 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.629721 (+ 763us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.630319 (+ 598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.630324 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.630328 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.630504 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.631694 (+ 1190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.631700 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.631914 (+ 214us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.632075 (+ 161us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.632402 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260805 23:06:28.634600 21498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.610884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42906 (local address 127.22.45.124:46275)
0805 23:06:28.611799 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.611813 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.611859 (+ 46us) server_negotiation.cc:407] Connection header received
0805 23:06:28.613622 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.613656 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.614109 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.614516 (+ 407us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.615550 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.618054 (+ 2504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.619929 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.621087 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.621298 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.624865 (+ 3567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.624875 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.624896 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.624956 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.628713 (+ 3757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.629889 (+ 1176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.629898 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.629907 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.630146 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.630658 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.630663 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.630666 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.631525 (+ 859us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.631755 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.632435 (+ 680us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.632978 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":354,"threads_started":1}
I20260805 23:06:28.637776 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.617462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42908 (local address 127.22.45.124:46275)
0805 23:06:28.618961 (+ 1499us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.618969 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.618998 (+ 29us) server_negotiation.cc:407] Connection header received
0805 23:06:28.619051 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.619065 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.619147 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.619270 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.621041 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.622250 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.624171 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.624811 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.624941 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.630472 (+ 5531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.630479 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.630483 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.630522 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.634204 (+ 3682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.635185 (+ 981us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.635190 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.635194 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.635421 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.635910 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.635915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.635919 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.636315 (+ 396us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.636623 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.637121 (+ 498us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.637385 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1310,"thread_start_us":1052,"threads_started":1}
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971188, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:28.644236 21275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25: Bootstrap starting.
I20260805 23:06:28.648806 21275 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:28.649327 21503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.626286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:43857 (local address 127.0.0.1:58060)
0805 23:06:28.629801 (+ 3515us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.629864 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.630114 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.630688 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.630699 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.631755 (+ 1056us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.632090 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.632104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.633727 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.633732 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.635463 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.635479 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.636480 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.636487 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.636710 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.637465 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.637488 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.641128 (+ 3640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.645787 (+ 4659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.645808 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.645816 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.646499 (+ 683us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.647041 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.647047 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.647051 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.647258 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.648015 (+ 757us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.648024 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.648253 (+ 229us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.648470 (+ 217us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.648869 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3217,"thread_start_us":3047,"threads_started":1}
I20260805 23:06:28.649338 21505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.626367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58060 (local address 127.22.45.126:43857)
0805 23:06:28.629176 (+ 2809us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.629183 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.629959 (+ 776us) server_negotiation.cc:407] Connection header received
0805 23:06:28.630272 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.630277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.630367 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.630437 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.632263 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.633456 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.635663 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.636265 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.636409 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.641417 (+ 5008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.641424 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.641429 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.641474 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.645597 (+ 4123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.646668 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.646673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.646676 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.646853 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.647402 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.647408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.647411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.647854 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.648041 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.648616 (+ 575us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.648894 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2621,"thread_start_us":808,"threads_started":1}
I20260805 23:06:28.650504 21275 log.cc:824] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:28.651369 21495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:28.656785 21275 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25: No bootstrap required, opened a new log
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971188, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:06:28.661295 21506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.639596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58072 (local address 127.22.45.126:43857)
0805 23:06:28.643699 (+ 4103us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.643705 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.643730 (+ 25us) server_negotiation.cc:407] Connection header received
0805 23:06:28.643795 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.643800 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.643886 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.644007 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.645524 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.646769 (+ 1245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.648332 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.649074 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.650040 (+ 966us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.654430 (+ 4390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.654436 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.654439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.654474 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.657492 (+ 3018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.658296 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.658300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.658302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.658468 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.659050 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.659056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.659059 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.659513 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.659813 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.660494 (+ 681us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.660793 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3945,"thread_start_us":3714,"threads_started":1}
I20260805 23:06:28.668341 21275 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.668684 21503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.652254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:32881 (local address 127.0.0.1:34304)
0805 23:06:28.652607 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.652628 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.652746 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.653095 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.653099 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.653614 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.653798 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.653812 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.655185 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.655191 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.656489 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.656506 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.657784 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.657791 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.658181 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.658841 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.658859 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.661211 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.665535 (+ 4324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.665542 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.665547 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.666171 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.666678 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.666683 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.666688 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.666881 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.667670 (+ 789us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.667674 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.667822 (+ 148us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.667950 (+ 128us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.668288 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211}
I20260805 23:06:28.668826 21275 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1aba2247294e481eac89e42015ef8d25, State: Initialized, Role: FOLLOWER
I20260805 23:06:28.668721 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.652595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34304 (local address 127.22.45.125:32881)
0805 23:06:28.652799 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.652806 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.652825 (+ 19us) server_negotiation.cc:407] Connection header received
0805 23:06:28.652888 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.652893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.652957 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.653047 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.653966 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.654979 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.656743 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.657385 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.657524 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.661479 (+ 3955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.661487 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.661491 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.661542 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.665338 (+ 3796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.666306 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.666312 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.666315 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.666531 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.667052 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.667057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.667060 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.667465 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.667604 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.668090 (+ 486us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.668332 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":88}
I20260805 23:06:28.669435 21275 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.670279 21495 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:06:28.670463 21509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.670876 21509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:28.671859 21275 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: configured and running, proceeding with master startup.
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971186, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971188, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
I20260805 23:06:28.683689 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.663320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34312 (local address 127.22.45.125:32881)
0805 23:06:28.664241 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.664247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.664273 (+ 26us) server_negotiation.cc:407] Connection header received
0805 23:06:28.664333 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.664337 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.664428 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.664548 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.666155 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.667406 (+ 1251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.669230 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.669972 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.670802 (+ 830us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.675814 (+ 5012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.675822 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.675827 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.675876 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.679475 (+ 3599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.680393 (+ 918us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.680400 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.680404 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.680613 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.681200 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.681207 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.681211 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.681629 (+ 418us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.681949 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.682907 (+ 958us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.683240 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":772,"thread_start_us":489,"threads_started":1}
I20260805 23:06:28.688364 21503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.671650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42922)
0805 23:06:28.672248 (+ 598us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.672269 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.672401 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.672780 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.672786 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.673300 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.673508 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.673520 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.675088 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.675094 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.676582 (+ 1488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.676601 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.677655 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.677662 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.677938 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.678487 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.678511 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.681281 (+ 2770us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.685274 (+ 3993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.685281 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.685286 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.685933 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.686422 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.686427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.686432 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.686624 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.687292 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.687297 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.687463 (+ 166us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.687619 (+ 156us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.688004 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478}
I20260805 23:06:28.689106 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.672007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42922 (local address 127.22.45.124:46275)
0805 23:06:28.672241 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.672247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.672344 (+ 97us) server_negotiation.cc:407] Connection header received
0805 23:06:28.672539 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.672544 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.672623 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.672734 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.673698 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.674882 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.676809 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.677464 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.677705 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.681484 (+ 3779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.681490 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.681493 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.681524 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.685083 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.686084 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.686090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.686094 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.686286 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.686755 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.686760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.686764 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.687178 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.687322 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.687788 (+ 466us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.688868 (+ 1080us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":805,"server-negotiator.queue_time_us":76}
I20260805 23:06:28.689867 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:28.694072 21495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: Bootstrap starting.
I20260805 23:06:28.694073 21241 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1aba2247294e481eac89e42015ef8d25"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58072
I20260805 23:06:28.694548 21241 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 23:06:28.694731 21241 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:28.697322 21241 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.697935 21495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:28.698810 21241 leader_election.cc:288] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [CANDIDATE]: Term 1 election: Requested vote from peers de2a75bae7894a9cbfe434e0cd0092e9 (127.22.45.125:32881), d3d7d4d0b60f40aaa7c2f7efcb1a5760 (127.22.45.124:46275)
I20260805 23:06:28.699532 21495 log.cc:824] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: Log is configured to *not* fsync() on all Append() calls
W20260805 23:06:28.703989 21208 tablet.cc:2369] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:06:28.704716 21495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: No bootstrap required, opened a new log
I20260805 23:06:28.716444 21495 raft_consensus.cc:348] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.716986 21495 raft_consensus.cc:729] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3d7d4d0b60f40aaa7c2f7efcb1a5760, State: Initialized, Role: FOLLOWER
I20260805 23:06:28.717571 21495 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.719167 21534 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.720243 21534 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:28.720448 21495 sys_catalog.cc:564] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:28.720520 21457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1aba2247294e481eac89e42015ef8d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760"
I20260805 23:06:28.721046 21457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:28.709326 21178 master_runner.cc:186] Error getting master registration for 127.22.45.125:32881: OK, instance_id { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" instance_seqno: 1785971188020385 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 23:06:28.724510 21178 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 23:06:28.724622 21457 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aba2247294e481eac89e42015ef8d25 in term 1.
I20260805 23:06:28.725488 21202 leader_election.cc:302] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1aba2247294e481eac89e42015ef8d25, d3d7d4d0b60f40aaa7c2f7efcb1a5760; no voters:
I20260805 23:06:28.726168 21509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:28.727063 21509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [term 1 LEADER]: Becoming Leader. State: Replica: 1aba2247294e481eac89e42015ef8d25, State: Running, Role: LEADER
I20260805 23:06:28.727824 21509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.731935 21537 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aba2247294e481eac89e42015ef8d25. Latest consensus state: current_term: 1 leader_uuid: "1aba2247294e481eac89e42015ef8d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.732636 21537 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: This master's current role is: LEADER
W20260805 23:06:28.749931 21522 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:06:28.750182 21522 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 23:06:28.750407 21543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:28.752884 21543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260805 23:06:28.755338 21377 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } attempt: 5
W20260805 23:06:28.755513 21555 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:06:28.755659 21555 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 23:06:28.748450 21388 master_runner.cc:186] Error getting master registration for 127.22.45.125:32881: OK, instance_id { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" instance_seqno: 1785971188020385 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 23:06:28.766115 21388 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 05 23:06:28 dist-test-slave-1vmg krb5kdc[21165](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971187, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
I20260805 23:06:28.782704 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.756093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:46275 (local address 127.0.0.1:42928)
0805 23:06:28.756558 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:28.756580 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:28.756721 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:28.758067 (+ 1346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:28.758073 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:28.758735 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:28.759021 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.759037 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.760943 (+ 1906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.760951 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.762617 (+ 1666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:28.762637 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.764263 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.764271 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:28.764557 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.765477 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:28.765506 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:28.769525 (+ 4019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:28.777444 (+ 7919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.777453 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.777458 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.778172 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.779163 (+ 991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:28.779170 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:28.779174 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:28.779506 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:28.780861 (+ 1355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:28.780868 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:28.781189 (+ 321us) client_negotiation.cc:769] Sending connection context
0805 23:06:28.781474 (+ 285us) client_negotiation.cc:240] Negotiation successful
0805 23:06:28.782088 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311}
I20260805 23:06:28.784911 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.757190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42928 (local address 127.22.45.124:46275)
0805 23:06:28.757424 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.757431 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.757458 (+ 27us) server_negotiation.cc:407] Connection header received
0805 23:06:28.757528 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.757538 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.757625 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.757750 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.759273 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.760684 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.762856 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.763713 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.763864 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.769854 (+ 5990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.769862 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.769868 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.769937 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.777176 (+ 7239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.778413 (+ 1237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.778421 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.778425 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.778731 (+ 306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.779793 (+ 1062us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.779800 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.779804 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.780577 (+ 773us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.783375 (+ 2798us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.783684 (+ 309us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.784181 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260805 23:06:28.792450 21377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9: Bootstrap starting.
I20260805 23:06:28.797546 21377 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:28.799307 21377 log.cc:824] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:28.813941 21457 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [term 1 FOLLOWER]: Refusing update from remote peer 1aba2247294e481eac89e42015ef8d25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:06:28.815740 21537 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:06:28.832913 21377 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9: No bootstrap required, opened a new log
W20260805 23:06:28.838907 21420 tablet.cc:2369] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:06:28.848335 21534 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aba2247294e481eac89e42015ef8d25. Latest consensus state: current_term: 1 leader_uuid: "1aba2247294e481eac89e42015ef8d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.849002 21534 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:28.852483 21377 raft_consensus.cc:348] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.853490 21377 raft_consensus.cc:729] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de2a75bae7894a9cbfe434e0cd0092e9, State: Initialized, Role: FOLLOWER
I20260805 23:06:28.854595 21377 consensus_queue.cc:260] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } }
I20260805 23:06:28.858440 21558 mvcc.cc:205] Tried to move back new op lower bound from 7315337989333188608 to 7315337989035864064. Current Snapshot: MvccSnapshot[applied={T|T < 7315337989333188608}]
I20260805 23:06:28.867121 21561 mvcc.cc:205] Tried to move back new op lower bound from 7315337989333188608 to 7315337989035864064. Current Snapshot: MvccSnapshot[applied={T|T < 7315337989333188608}]
I20260805 23:06:28.866876 21341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1aba2247294e481eac89e42015ef8d25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "de2a75bae7894a9cbfe434e0cd0092e9"
I20260805 23:06:28.867410 21340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:28.867776 21377 sys_catalog.cc:564] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:28.870816 21509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1aba2247294e481eac89e42015ef8d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.871263 21509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:28.871693 21340 raft_consensus.cc:1261] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [term 1 FOLLOWER]: Refusing update from remote peer 1aba2247294e481eac89e42015ef8d25: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:06:28.872941 21537 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:06:28.875995 21341 raft_consensus.cc:2454] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1aba2247294e481eac89e42015ef8d25 in term 1.
I20260805 23:06:28.879180 21568 sys_catalog.cc:455] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.879783 21568 sys_catalog.cc:458] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:28.887696 21534 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1aba2247294e481eac89e42015ef8d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.888176 21534 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:28.897019 21506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.828504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58088 (local address 127.22.45.126:43857)
0805 23:06:28.828763 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.828771 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.834188 (+ 5417us) server_negotiation.cc:407] Connection header received
0805 23:06:28.837042 (+ 2854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.837049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.837149 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.837227 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.844618 (+ 7391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.845792 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.856910 (+ 11118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.857847 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.857974 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.876996 (+ 19022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.877004 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.877010 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.877067 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.881571 (+ 4504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.893621 (+ 12050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.893630 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.893634 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.893899 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.894528 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.894534 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.894538 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.895077 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.895369 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.896074 (+ 705us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.896426 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 23:06:28.898720 21543 catalog_manager.cc:1347] Generated new cluster ID: ab9999b714424db0a0b51a878b1dd94c
I20260805 23:06:28.898847 21543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:28.918581 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.834573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34322 (local address 127.22.45.125:32881)
0805 23:06:28.834790 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.834796 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.844447 (+ 9651us) server_negotiation.cc:407] Connection header received
0805 23:06:28.851768 (+ 7321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.851775 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.851881 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.851967 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.863108 (+ 11141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.864292 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.873816 (+ 9524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.874614 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.874763 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.901920 (+ 27157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.901929 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.901935 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.901993 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.906149 (+ 4156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.914350 (+ 8201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.914357 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.914361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.914559 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.915102 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.915108 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.915112 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.915556 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.915851 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.917760 (+ 1909us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.918086 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 23:06:28.923527 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:28.835072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.22.45.124:46275)
0805 23:06:28.835271 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:28.835277 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:28.853881 (+ 18604us) server_negotiation.cc:407] Connection header received
0805 23:06:28.854169 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:28.854175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:28.854262 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:28.854350 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:28.866435 (+ 12085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.867565 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.875451 (+ 7886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:28.876216 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:28.876344 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:28.909176 (+ 32832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:28.909184 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:28.909189 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:28.909243 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:28.913228 (+ 3985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.916897 (+ 3669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.916905 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.916909 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.917126 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:28.919593 (+ 2467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:28.919600 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:28.919603 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:28.920022 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:28.920270 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:28.922785 (+ 2515us) server_negotiation.cc:299] Negotiation successful
0805 23:06:28.923127 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 23:06:28.943583 21573 sys_catalog.cc:455] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1aba2247294e481eac89e42015ef8d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.944082 21543 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:28.944099 21573 sys_catalog.cc:458] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:28.944690 21568 sys_catalog.cc:455] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1aba2247294e481eac89e42015ef8d25. Latest consensus state: current_term: 1 leader_uuid: "1aba2247294e481eac89e42015ef8d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.944989 21568 sys_catalog.cc:458] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:28.946004 21543 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:28.948153 21509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1aba2247294e481eac89e42015ef8d25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1aba2247294e481eac89e42015ef8d25" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 43857 } } peers { permanent_uuid: "de2a75bae7894a9cbfe434e0cd0092e9" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 32881 } } peers { permanent_uuid: "d3d7d4d0b60f40aaa7c2f7efcb1a5760" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 46275 } } }
I20260805 23:06:28.948482 21509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25 [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:28.962085 21543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1aba2247294e481eac89e42015ef8d25: Generated new TSK 0
I20260805 23:06:28.963440 21543 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260805 23:06:29.001060 21596 catalog_manager.cc:1259] Loaded cluster ID: ab9999b714424db0a0b51a878b1dd94c
I20260805 23:06:29.001222 21596 catalog_manager.cc:1552] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9: loading cluster ID for follower catalog manager: success
I20260805 23:06:29.005570 21596 catalog_manager.cc:1574] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9: acquiring CA information for follower catalog manager: success
I20260805 23:06:29.016752 21596 catalog_manager.cc:1602] T 00000000000000000000000000000000 P de2a75bae7894a9cbfe434e0cd0092e9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260805 23:06:29.082597 22709 mini_kdc.cc:348] Time spent kdestroy: real 0.103s user 0.001s sys 0.031s
W20260805 23:06:29.155385 21506 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.117148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58104 (local address 127.22.45.126:43857)
0805 23:06:29.117372 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.117380 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.147990 (+ 30610us) server_negotiation.cc:407] Connection header received
0805 23:06:29.150764 (+ 2774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.150772 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.150876 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.151003 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.155101 (+ 4098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58104: BlockingRecv error: recv got EOF from 127.0.0.1:58104 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260805 23:06:29.158438 21508 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.123696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34326 (local address 127.22.45.125:32881)
0805 23:06:29.123940 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.123947 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.154094 (+ 30147us) server_negotiation.cc:407] Connection header received
0805 23:06:29.156669 (+ 2575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.156676 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.156809 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.156893 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.158141 (+ 1248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34326: BlockingRecv error: recv got EOF from 127.0.0.1:34326 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260805 23:06:29.161123 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.132618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42950 (local address 127.22.45.124:46275)
0805 23:06:29.132828 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.132833 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.156519 (+ 23686us) server_negotiation.cc:407] Connection header received
0805 23:06:29.159521 (+ 3002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.159528 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.159618 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.159692 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.160820 (+ 1128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42950: BlockingRecv error: recv got EOF from 127.0.0.1:42950 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260805 23:06:29.210625 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.193038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.22.45.125:32881)
0805 23:06:29.193247 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.193254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.201429 (+ 8175us) server_negotiation.cc:407] Connection header received
0805 23:06:29.202071 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.202078 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.202342 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.202502 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.203908 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.205106 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.207261 (+ 2155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.207991 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.208100 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.208986 (+ 886us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.209740 (+ 754us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.209881 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.210128 (+ 247us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.210239 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260805 23:06:29.271060 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.259688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42954 (local address 127.22.45.124:46275)
0805 23:06:29.259929 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.259937 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.268855 (+ 8918us) server_negotiation.cc:407] Connection header received
0805 23:06:29.269144 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.269151 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.269348 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.269467 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.270744 (+ 1277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42954: BlockingRecv error: recv got EOF from 127.0.0.1:42954 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260805 23:06:29.319293 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.304655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34350 (local address 127.22.45.125:32881)
0805 23:06:29.304900 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.304907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.311837 (+ 6930us) server_negotiation.cc:407] Connection header received
0805 23:06:29.312448 (+ 611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.312456 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.312565 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.312638 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.313416 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.314538 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.316713 (+ 2175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.317463 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.317593 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.318308 (+ 715us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.318501 (+ 193us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.318571 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.318820 (+ 249us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.318947 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
W20260805 23:06:29.397607 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.381424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42956 (local address 127.22.45.124:46275)
0805 23:06:29.381630 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.381637 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.395637 (+ 14000us) server_negotiation.cc:407] Connection header received
0805 23:06:29.395893 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.395900 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.396039 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.396119 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.397304 (+ 1185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42956: BlockingRecv error: recv got EOF from 127.0.0.1:42956 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260805 23:06:29.459805 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.445819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34352 (local address 127.22.45.125:32881)
0805 23:06:29.446000 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.446006 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.453803 (+ 7797us) server_negotiation.cc:407] Connection header received
0805 23:06:29.454127 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.454135 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.454227 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.454292 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.455076 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.455954 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.457559 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.458038 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.458167 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.458962 (+ 795us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.459109 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.459212 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.459370 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.459469 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260805 23:06:29.473960 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.469474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42960 (local address 127.22.45.124:46275)
0805 23:06:29.469685 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.469693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.472450 (+ 2757us) server_negotiation.cc:407] Connection header received
0805 23:06:29.472648 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.472655 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.472744 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.472835 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.473783 (+ 948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42960: BlockingRecv error: recv got EOF from 127.0.0.1:42960 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260805 23:06:29.487763 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.482182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34368 (local address 127.22.45.125:32881)
0805 23:06:29.482371 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.482378 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.482440 (+ 62us) server_negotiation.cc:407] Connection header received
0805 23:06:29.482759 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.482770 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.482908 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.483032 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.483508 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.484470 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.485903 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.486369 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.486488 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.486957 (+ 469us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.487089 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.487183 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.487333 (+ 150us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.487433 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260805 23:06:29.501694 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.494170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42962 (local address 127.22.45.124:46275)
0805 23:06:29.494498 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.494506 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.499744 (+ 5238us) server_negotiation.cc:407] Connection header received
0805 23:06:29.499983 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.499988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.500097 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.500211 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.501422 (+ 1211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42962: BlockingRecv error: recv got EOF from 127.0.0.1:42962 (error 108)
Metrics: {"server-negotiator.queue_time_us":175}
I20260805 23:06:29.520167 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.513608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34382 (local address 127.22.45.125:32881)
0805 23:06:29.513868 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.513874 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.514147 (+ 273us) server_negotiation.cc:407] Connection header received
0805 23:06:29.514351 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.514355 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.514436 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.514527 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.515041 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.515847 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.517935 (+ 2088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.518449 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.518573 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.519282 (+ 709us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.519463 (+ 181us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.519546 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.519704 (+ 158us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.519804 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
W20260805 23:06:29.528968 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.526471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.22.45.124:46275)
0805 23:06:29.526654 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.526659 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.527452 (+ 793us) server_negotiation.cc:407] Connection header received
0805 23:06:29.527657 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.527662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.527757 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.527850 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.528729 (+ 879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42972: BlockingRecv error: recv got EOF from 127.0.0.1:42972 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260805 23:06:29.554155 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.548891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34388 (local address 127.22.45.125:32881)
0805 23:06:29.549113 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.549120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.549427 (+ 307us) server_negotiation.cc:407] Connection header received
0805 23:06:29.549630 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.549634 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.549715 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.549795 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.550225 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.551023 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.552450 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.552879 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.552996 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.553435 (+ 439us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.553558 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.553635 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.553789 (+ 154us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.553879 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
W20260805 23:06:29.562381 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.560306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42986 (local address 127.22.45.124:46275)
0805 23:06:29.560556 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.560562 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.560880 (+ 318us) server_negotiation.cc:407] Connection header received
0805 23:06:29.561059 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.561064 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.561147 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.561241 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.562118 (+ 877us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42986: BlockingRecv error: recv got EOF from 127.0.0.1:42986 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260805 23:06:29.603559 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.598219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34394 (local address 127.22.45.125:32881)
0805 23:06:29.598431 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.598438 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.598725 (+ 287us) server_negotiation.cc:407] Connection header received
0805 23:06:29.598960 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.598966 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.599046 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.599130 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.599572 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.600370 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.601786 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.602226 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.602341 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.602801 (+ 460us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.602946 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.603026 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.603183 (+ 157us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.603273 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260805 23:06:29.612040 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.609925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42992 (local address 127.22.45.124:46275)
0805 23:06:29.610155 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.610162 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.610538 (+ 376us) server_negotiation.cc:407] Connection header received
0805 23:06:29.610726 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.610730 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.610806 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.610892 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.611834 (+ 942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42992: BlockingRecv error: recv got EOF from 127.0.0.1:42992 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260805 23:06:29.685411 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.680011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34402 (local address 127.22.45.125:32881)
0805 23:06:29.680288 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.680295 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.680635 (+ 340us) server_negotiation.cc:407] Connection header received
0805 23:06:29.680857 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.680861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.680935 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.681016 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.681442 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.682213 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.683654 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.684110 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.684238 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.684657 (+ 419us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.684796 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.684874 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.685031 (+ 157us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.685123 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
W20260805 23:06:29.692857 21501 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:29.691006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43006 (local address 127.22.45.124:46275)
0805 23:06:29.691224 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.691231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.691476 (+ 245us) server_negotiation.cc:407] Connection header received
0805 23:06:29.691675 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.691679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.691769 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.691857 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:29.692648 (+ 791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43006: BlockingRecv error: recv got EOF from 127.0.0.1:43006 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
I20260805 23:06:29.757714 21555 catalog_manager.cc:1259] Loaded cluster ID: ab9999b714424db0a0b51a878b1dd94c
I20260805 23:06:29.757822 21555 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: loading cluster ID for follower catalog manager: success
I20260805 23:06:29.760347 21555 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: acquiring CA information for follower catalog manager: success
I20260805 23:06:29.762174 21555 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d3d7d4d0b60f40aaa7c2f7efcb1a5760: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 23:06:29.829774 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.824666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34410 (local address 127.22.45.125:32881)
0805 23:06:29.824931 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.824938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.825194 (+ 256us) server_negotiation.cc:407] Connection header received
0805 23:06:29.825401 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.825405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.825480 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.825560 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.825960 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.826724 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.828245 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.828678 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.828773 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.829177 (+ 404us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.829297 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.829365 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.829476 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.829550 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260805 23:06:29.842329 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.836028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43014 (local address 127.22.45.124:46275)
0805 23:06:29.836241 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.836249 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.836542 (+ 293us) server_negotiation.cc:407] Connection header received
0805 23:06:29.836736 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.836741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.836902 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.837010 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.837521 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.838280 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.839915 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.840461 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.840606 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.841142 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.841826 (+ 684us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.841947 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.841996 (+ 49us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.842079 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:06:29.866896 21508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.849163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34416 (local address 127.22.45.125:32881)
0805 23:06:29.849352 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.849358 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.860876 (+ 11518us) server_negotiation.cc:407] Connection header received
0805 23:06:29.861059 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.861065 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.861174 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.861265 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.861879 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.862878 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.864753 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.865412 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.865553 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.866029 (+ 476us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.866185 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.866283 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.866458 (+ 175us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.866555 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 23:06:29.867417 21750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.848848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58112 (local address 127.22.45.126:43857)
0805 23:06:29.859576 (+ 10728us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.859582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.860213 (+ 631us) server_negotiation.cc:407] Connection header received
0805 23:06:29.860582 (+ 369us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.860590 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.860803 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.861045 (+ 242us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.861665 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.862629 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.864699 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.865137 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.865260 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.866102 (+ 842us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.866564 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.866666 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.867004 (+ 338us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.867099 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10565,"thread_start_us":10436,"threads_started":1}
I20260805 23:06:29.868067 21501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:29.848967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43022 (local address 127.22.45.124:46275)
0805 23:06:29.849185 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:29.849191 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:29.860864 (+ 11673us) server_negotiation.cc:407] Connection header received
0805 23:06:29.861770 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:29.861776 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:29.861882 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:29.861982 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:29.862574 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.863603 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.865767 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:29.866376 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:29.866494 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:29.867143 (+ 649us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:29.867285 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:29.867352 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:29.867703 (+ 351us) server_negotiation.cc:299] Negotiation successful
0805 23:06:29.867787 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 23:06:29.873536 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21178
I20260805 23:06:29.875026 21268 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:29.988243 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 21178
W20260805 23:06:30.011065 21411 connection.cc:535] server connection from 127.0.0.1:42906 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260805 23:06:30.011451 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21287
I20260805 23:06:30.012596 21368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:30.123129 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 21287
I20260805 23:06:30.149118 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21388
I20260805 23:06:30.150231 21486 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:30.261444 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 21388
2026-08-05T23:06:30Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4855 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 05 23:06:30 dist-test-slave-1vmg krb5kdc[21765](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 05 23:06:30 dist-test-slave-1vmg krb5kdc[21765](info): set up 2 sockets
Aug 05 23:06:30 dist-test-slave-1vmg krb5kdc[21765](info): commencing operation
krb5kdc: starting...
W20260805 23:06:31.485857 22709 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.000s sys 0.052s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/test-user.keytab.
Aug 05 23:06:31 dist-test-slave-1vmg krb5kdc[21765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-05T23:06:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-05T23:06:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.45.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
Entry for principal kudu/127.22.45.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab.
I20260805 23:06:31.824679 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38357
--webserver_interface=127.22.45.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:38357,127.22.45.125:38269,127.22.45.124:33533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260805 23:06:32.187696 21792 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 23:06:32.188119 21792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:32.188244 21792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:32.188369 21792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:32.196214 21792 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:32.196364 21792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:32.196457 21792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:32.196534 21792 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:32.196631 21792 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:32.207715 21792 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:38357,127.22.45.125:38269,127.22.45.124:33533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.126.keytab
--principal=kudu/127.22.45.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.126:38357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.45.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:32.209254 21792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:32.210740 21792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:32.223438 21799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:32.223620 21802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:32.223680 21798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:32.225742 21792 server_base.cc:1034] running on GCE node
I20260805 23:06:32.226658 21792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:32.228343 21792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:32.229591 21792 hybrid_clock.cc:648] HybridClock initialized: now 1785971192229511 us; error 49 us; skew 500 ppm
I20260805 23:06:32.229964 21792 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:32 dist-test-slave-1vmg krb5kdc[21765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:32.234169 21792 init.cc:377] Logged in from keytab as kudu/127.22.45.126@KRBTEST.COM (short username kudu)
I20260805 23:06:32.236230 21792 webserver.cc:460] Webserver started at http://127.22.45.126:46301/ using document root <none> and password file <none>
I20260805 23:06:32.237025 21792 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:32.237149 21792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:32.237507 21792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:32.240988 21792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data/instance:
uuid: "a3254a69166547b7814c461e15286dff"
format_stamp: "Formatted at 2026-08-05 23:06:32 on dist-test-slave-1vmg"
server_key: "9bf29c3c910d34e29543ab232e9241a6"
server_key_iv: "9dec829276a0f67db11cda68c107a06b"
server_key_version: "encryptionkey@0"
I20260805 23:06:32.241930 21792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/wal/instance:
uuid: "a3254a69166547b7814c461e15286dff"
format_stamp: "Formatted at 2026-08-05 23:06:32 on dist-test-slave-1vmg"
server_key: "9bf29c3c910d34e29543ab232e9241a6"
server_key_iv: "9dec829276a0f67db11cda68c107a06b"
server_key_version: "encryptionkey@0"
I20260805 23:06:32.248216 21792 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260805 23:06:32.252882 21813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:32.254544 21792 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260805 23:06:32.254781 21792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/wal
uuid: "a3254a69166547b7814c461e15286dff"
format_stamp: "Formatted at 2026-08-05 23:06:32 on dist-test-slave-1vmg"
server_key: "9bf29c3c910d34e29543ab232e9241a6"
server_key_iv: "9dec829276a0f67db11cda68c107a06b"
server_key_version: "encryptionkey@0"
I20260805 23:06:32.255129 21792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:32.287253 21792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:32.292084 21792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:32.292399 21792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:32.312520 21792 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.126:38357
I20260805 23:06:32.312531 21882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.126:38357 every 8 connection(s)
I20260805 23:06:32.314045 21792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/data/info.pb
I20260805 23:06:32.318152 21884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:32.320084 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 21792
I20260805 23:06:32.320292 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-0/wal/instance
I20260805 23:06:32.320866 22709 external_mini_cluster.cc:1428] Setting key b1d8b616bb271ec8bf69810904b86b8c
I20260805 23:06:32.327544 21884 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:32 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:32.356664 21887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.331912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59502 (local address 127.22.45.126:38357)
0805 23:06:32.335585 (+ 3673us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:32.335593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:32.335644 (+ 51us) server_negotiation.cc:407] Connection header received
0805 23:06:32.336653 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:32.336663 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:32.337087 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:32.337341 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:32.338872 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.340240 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.342501 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.343227 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.343387 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:32.348040 (+ 4653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:32.348052 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:32.348068 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:32.348106 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:32.351615 (+ 3509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:32.352728 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:32.352739 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:32.352743 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:32.352953 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:32.353504 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:32.353509 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:32.353511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:32.354132 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:32.354305 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:32.355098 (+ 793us) server_negotiation.cc:299] Negotiation successful
0805 23:06:32.355498 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":3440,"spinlock_wait_cycles":46976,"thread_start_us":3158,"threads_started":1}
I20260805 23:06:32.356715 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.331912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38357 (local address 127.0.0.1:59502)
0805 23:06:32.333094 (+ 1182us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.333161 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:32.336113 (+ 2952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:32.337358 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:32.337363 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:32.338103 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:32.338612 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:32.338640 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.340445 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.340451 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:32.342295 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:32.342318 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.343530 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.343538 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:32.343716 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:32.344489 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:32.344520 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:32.347714 (+ 3194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:32.351840 (+ 4126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:32.351856 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:32.351871 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:32.352524 (+ 653us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:32.353120 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:32.353126 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:32.353130 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:32.353378 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:32.354311 (+ 933us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:32.354321 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:32.354590 (+ 269us) client_negotiation.cc:769] Sending connection context
0805 23:06:32.354942 (+ 352us) client_negotiation.cc:240] Negotiation successful
0805 23:06:32.355691 (+ 749us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"mutex_wait_us":146,"thread_start_us":447,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.125@KRBTEST.COM" created.
I20260805 23:06:32.359833 21884 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:06:32.361173 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.360708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38160)
0805 23:06:32.360920 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.361041 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260805 23:06:32.361460 21815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
I20260805 23:06:32.363142 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.362725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38162)
0805 23:06:32.362881 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.362985 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260805 23:06:32.363358 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:38269: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab.
Entry for principal kudu/127.22.45.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab.
I20260805 23:06:32.400380 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:38269
--webserver_interface=127.22.45.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab
--principal=kudu/127.22.45.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:38357,127.22.45.125:38269,127.22.45.124:33533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:06:32.412771 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } attempt: 1
I20260805 23:06:32.414338 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.413682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38168)
0805 23:06:32.413947 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.414157 (+ 210us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260805 23:06:32.415628 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.415237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38178)
0805 23:06:32.415387 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.415473 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260805 23:06:32.415830 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:38269: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
I20260805 23:06:32.484165 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } attempt: 2
I20260805 23:06:32.485482 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.484976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38192)
0805 23:06:32.485242 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.485339 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260805 23:06:32.486521 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.486133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38200)
0805 23:06:32.486292 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.486368 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260805 23:06:32.486734 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:38269: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
I20260805 23:06:32.578004 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } attempt: 3
I20260805 23:06:32.579393 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.578882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38208)
0805 23:06:32.579134 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.579246 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260805 23:06:32.580516 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.580107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38212)
0805 23:06:32.580275 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.580357 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260805 23:06:32.580742 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:38269: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
I20260805 23:06:32.723979 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } attempt: 4
I20260805 23:06:32.725181 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.724614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38228)
0805 23:06:32.724943 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.725035 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168}
I20260805 23:06:32.726147 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.725800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38244)
0805 23:06:32.725945 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.726028 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260805 23:06:32.726366 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.125:38269: Network error: Client connection negotiation failed: client connection to 127.22.45.125:38269: connect: Connection refused (error 111)
W20260805 23:06:32.773613 21894 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 23:06:32.774011 21894 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:32.774120 21894 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:32.774242 21894 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:32.781759 21894 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:32.781886 21894 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:32.781977 21894 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:32.782050 21894 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:32.782161 21894 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:32.792443 21894 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:38357,127.22.45.125:38269,127.22.45.124:33533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.125.keytab
--principal=kudu/127.22.45.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.125:38269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.45.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:32.793903 21894 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:32.795447 21894 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:32.807399 21900 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:32.807479 21899 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:32.807513 21902 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:32.808753 21894 server_base.cc:1034] running on GCE node
I20260805 23:06:32.809857 21894 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:32.811491 21894 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:32.812739 21894 hybrid_clock.cc:648] HybridClock initialized: now 1785971192812664 us; error 48 us; skew 500 ppm
I20260805 23:06:32.813126 21894 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:32 dist-test-slave-1vmg krb5kdc[21765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:32.816597 21894 init.cc:377] Logged in from keytab as kudu/127.22.45.125@KRBTEST.COM (short username kudu)
I20260805 23:06:32.818233 21894 webserver.cc:460] Webserver started at http://127.22.45.125:46383/ using document root <none> and password file <none>
I20260805 23:06:32.819056 21894 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:32.819178 21894 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:32.819522 21894 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:32.822881 21894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data/instance:
uuid: "0d88ae6e5c614bdcad579865bb23a3b3"
format_stamp: "Formatted at 2026-08-05 23:06:32 on dist-test-slave-1vmg"
server_key: "88cb78be250312a629ffdb6cf347657f"
server_key_iv: "4428bdae06c404d94b2309e76e55bee9"
server_key_version: "encryptionkey@0"
I20260805 23:06:32.823843 21894 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/wal/instance:
uuid: "0d88ae6e5c614bdcad579865bb23a3b3"
format_stamp: "Formatted at 2026-08-05 23:06:32 on dist-test-slave-1vmg"
server_key: "88cb78be250312a629ffdb6cf347657f"
server_key_iv: "4428bdae06c404d94b2309e76e55bee9"
server_key_version: "encryptionkey@0"
I20260805 23:06:32.829747 21894 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260805 23:06:32.833912 21909 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:32.835573 21894 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260805 23:06:32.835764 21894 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/wal
uuid: "0d88ae6e5c614bdcad579865bb23a3b3"
format_stamp: "Formatted at 2026-08-05 23:06:32 on dist-test-slave-1vmg"
server_key: "88cb78be250312a629ffdb6cf347657f"
server_key_iv: "4428bdae06c404d94b2309e76e55bee9"
server_key_version: "encryptionkey@0"
I20260805 23:06:32.835999 21894 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:32.862602 21894 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:32.867311 21894 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:32.867592 21894 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:32.886595 21894 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.125:38269
I20260805 23:06:32.886602 21985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.125:38269 every 8 connection(s)
I20260805 23:06:32.888098 21894 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/data/info.pb
I20260805 23:06:32.891656 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 21894
I20260805 23:06:32.891853 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-1/wal/instance
I20260805 23:06:32.892447 22709 external_mini_cluster.cc:1428] Setting key a2e152940f29388c03d5f146d96d4f55
I20260805 23:06:32.892586 21986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:32.902243 21986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:32 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:32.926780 21988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.905878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59504 (local address 127.22.45.126:38357)
0805 23:06:32.906445 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:32.906453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:32.907652 (+ 1199us) server_negotiation.cc:407] Connection header received
0805 23:06:32.909809 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:32.909816 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:32.909916 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:32.910040 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:32.911880 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.912917 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.914595 (+ 1678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.915298 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.915441 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:32.919572 (+ 4131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:32.919579 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:32.919584 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:32.919644 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:32.923072 (+ 3428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:32.924028 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:32.924034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:32.924038 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:32.924226 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:32.924678 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:32.924684 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:32.924688 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:32.925107 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:32.925299 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:32.926094 (+ 795us) server_negotiation.cc:299] Negotiation successful
0805 23:06:32.926361 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":269,"threads_started":1}
WARNING: no policy specified for kudu/127.22.45.124@KRBTEST.COM; defaulting to no policy
I20260805 23:06:32.927644 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.906534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38357 (local address 127.0.0.1:59504)
0805 23:06:32.907441 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.907499 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:32.909475 (+ 1976us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:32.910279 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:32.910289 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:32.910901 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:32.911610 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:32.911632 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.913120 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.913124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:32.914408 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:32.914424 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.915533 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.915539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:32.915780 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:32.916585 (+ 805us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:32.916611 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:32.919240 (+ 2629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:32.923263 (+ 4023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:32.923273 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:32.923291 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:32.923856 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:32.924344 (+ 488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:32.924348 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:32.924350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:32.924546 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:32.925227 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:32.925234 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:32.925674 (+ 440us) client_negotiation.cc:769] Sending connection context
0805 23:06:32.925924 (+ 250us) client_negotiation.cc:240] Negotiation successful
0805 23:06:32.926376 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":349,"threads_started":1}
I20260805 23:06:32.929740 21986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.45.124@KRBTEST.COM" created.
Aug 05 23:06:32 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:06:32.945740 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.930704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38254)
0805 23:06:32.930966 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.930989 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:32.931137 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:32.931942 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:32.931947 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:32.932488 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:32.932691 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:32.932703 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.934173 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.934178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:32.935321 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:32.935336 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.936215 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.936220 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:32.936374 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:32.937020 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:32.937042 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:32.939657 (+ 2615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:32.943256 (+ 3599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:32.943261 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:32.943265 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:32.943771 (+ 506us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:32.944148 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:32.944153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:32.944156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:32.944334 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:32.944986 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:32.944990 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:32.945128 (+ 138us) client_negotiation.cc:769] Sending connection context
0805 23:06:32.945236 (+ 108us) client_negotiation.cc:240] Negotiation successful
0805 23:06:32.945464 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 23:06:32.946147 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.930722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38254 (local address 127.22.45.125:38269)
0805 23:06:32.931442 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:32.931449 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:32.931479 (+ 30us) server_negotiation.cc:407] Connection header received
0805 23:06:32.931539 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:32.931546 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:32.931768 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:32.931898 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:32.932888 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.934014 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.935455 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:32.936038 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:32.936138 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:32.939922 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:32.939960 (+ 38us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:32.939978 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:32.940037 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:32.943093 (+ 3056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:32.943915 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:32.943922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:32.943925 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:32.944051 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:32.944442 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:32.944445 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:32.944447 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:32.944848 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:32.945079 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:32.945439 (+ 360us) server_negotiation.cc:299] Negotiation successful
0805 23:06:32.945730 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":391,"threads_started":1}
I20260805 23:06:32.948948 21986 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:06:32.950117 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.949629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43264)
0805 23:06:32.949820 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.949956 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260805 23:06:32.950403 21911 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:32.952062 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:32.951709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43280)
0805 23:06:32.951859 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:32.951947 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260805 23:06:32.952296 21986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.45.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab.
Entry for principal kudu/127.22.45.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab.
I20260805 23:06:32.970156 22709 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
/tmp/dist-test-taskNZyF8v/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:33533
--webserver_interface=127.22.45.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab
--principal=kudu/127.22.45.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.45.84:38067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.45.126:38357,127.22.45.125:38269,127.22.45.124:33533
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260805 23:06:33.001657 21986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 1
I20260805 23:06:33.002895 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.002417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43290)
0805 23:06:33.002621 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.002741 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260805 23:06:33.004070 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.003636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43302)
0805 23:06:33.003826 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.003928 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260805 23:06:33.004287 21986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:33.025625 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } attempt: 5
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:06:33.040467 21993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.026520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38264 (local address 127.22.45.125:38269)
0805 23:06:33.026710 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.026716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.026821 (+ 105us) server_negotiation.cc:407] Connection header received
0805 23:06:33.027057 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.027061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.027162 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.027255 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.028144 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.028850 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.030062 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.030537 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.030671 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.034479 (+ 3808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.034485 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.034488 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.034528 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.037416 (+ 2888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.038238 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.038243 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.038246 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.038388 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.038822 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.038826 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.038828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.039216 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.039366 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.039842 (+ 476us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.040118 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260805 23:06:33.040465 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.026455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38264)
0805 23:06:33.026710 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.026734 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:33.026886 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:33.027315 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:33.027320 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:33.027774 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:33.027964 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.027975 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.029001 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.029005 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.029883 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.029897 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.030723 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.030729 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.030998 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.031675 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:33.031694 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:33.034211 (+ 2517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:33.037622 (+ 3411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.037628 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.037631 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.038092 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.038522 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.038528 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.038532 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.038701 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.039351 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:33.039356 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:33.039535 (+ 179us) client_negotiation.cc:769] Sending connection context
0805 23:06:33.039690 (+ 155us) client_negotiation.cc:240] Negotiation successful
0805 23:06:33.040108 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90}
I20260805 23:06:33.041678 21884 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } has no permanent_uuid. Determining permanent_uuid...
I20260805 23:06:33.042791 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.042378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43312)
0805 23:06:33.042542 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.042637 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260805 23:06:33.043738 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.043387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43324)
0805 23:06:33.043531 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.043627 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260805 23:06:33.043931 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:33.072566 21986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 2
I20260805 23:06:33.073968 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.073382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43332)
0805 23:06:33.073638 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.073761 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260805 23:06:33.075186 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.074717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43344)
0805 23:06:33.074886 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.075027 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260805 23:06:33.075429 21986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:33.095157 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 1
I20260805 23:06:33.096349 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.095870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43350)
0805 23:06:33.096077 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.096175 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260805 23:06:33.097321 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.096987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43360)
0805 23:06:33.097138 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.097210 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260805 23:06:33.097538 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:33.165820 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 2
I20260805 23:06:33.166955 21986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 3
I20260805 23:06:33.167918 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.166635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43368)
0805 23:06:33.166987 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.167206 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260805 23:06:33.168103 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.167617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43382)
0805 23:06:33.167821 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.167923 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260805 23:06:33.169114 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.168701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43392)
0805 23:06:33.168883 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.168982 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260805 23:06:33.169356 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.168817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43398)
0805 23:06:33.169104 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.169210 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179}
W20260805 23:06:33.169587 21986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
W20260805 23:06:33.169607 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:33.275888 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 3
I20260805 23:06:33.277244 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.276706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43406)
0805 23:06:33.276939 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.277036 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260805 23:06:33.278362 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.277977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43408)
0805 23:06:33.278147 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.278236 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260805 23:06:33.278633 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:33.312870 21986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 4
I20260805 23:06:33.314376 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.313759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43422)
0805 23:06:33.314052 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.314169 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260805 23:06:33.315765 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.315268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43436)
0805 23:06:33.315461 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.315587 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260805 23:06:33.316067 21986 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
W20260805 23:06:33.345288 21998 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260805 23:06:33.345742 21998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260805 23:06:33.345849 21998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260805 23:06:33.345978 21998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260805 23:06:33.354023 21998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260805 23:06:33.354171 21998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260805 23:06:33.354260 21998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260805 23:06:33.354331 21998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260805 23:06:33.354421 21998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260805 23:06:33.367179 21998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.45.84:38067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.45.126:38357,127.22.45.125:38269,127.22.45.124:33533
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/krb5kdc/kudu_127.22.45.124.keytab
--principal=kudu/127.22.45.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.45.124:33533
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.45.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 05 Aug 2026 21:57:31 UTC on ccycloud.quasar-jetobj.root.comops.site
build id 4569245
ASAN enabled
I20260805 23:06:33.369251 21998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260805 23:06:33.371126 21998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260805 23:06:33.384438 22006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:33.384397 22007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260805 23:06:33.384469 22010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260805 23:06:33.385705 21998 server_base.cc:1034] running on GCE node
I20260805 23:06:33.386600 21998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260805 23:06:33.388270 21998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260805 23:06:33.389545 21998 hybrid_clock.cc:648] HybridClock initialized: now 1785971193389481 us; error 39 us; skew 500 ppm
I20260805 23:06:33.389930 21998 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971193, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260805 23:06:33.393486 21998 init.cc:377] Logged in from keytab as kudu/127.22.45.124@KRBTEST.COM (short username kudu)
I20260805 23:06:33.395484 21998 webserver.cc:460] Webserver started at http://127.22.45.124:38929/ using document root <none> and password file <none>
I20260805 23:06:33.396278 21998 fs_manager.cc:359] Metadata directory not provided
I20260805 23:06:33.396399 21998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260805 23:06:33.396742 21998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260805 23:06:33.400656 21998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data/instance:
uuid: "d2143a2362cc4833ae7d20f0d1069f64"
format_stamp: "Formatted at 2026-08-05 23:06:33 on dist-test-slave-1vmg"
server_key: "32b9d52def40acb8dccfa93efc74f21c"
server_key_iv: "f356f8cb243f6bcc292f99bc287c6335"
server_key_version: "encryptionkey@0"
I20260805 23:06:33.401618 21998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/wal/instance:
uuid: "d2143a2362cc4833ae7d20f0d1069f64"
format_stamp: "Formatted at 2026-08-05 23:06:33 on dist-test-slave-1vmg"
server_key: "32b9d52def40acb8dccfa93efc74f21c"
server_key_iv: "f356f8cb243f6bcc292f99bc287c6335"
server_key_version: "encryptionkey@0"
I20260805 23:06:33.408578 21998 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260805 23:06:33.413703 22021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260805 23:06:33.415542 21998 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260805 23:06:33.415798 21998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data,/tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/wal
uuid: "d2143a2362cc4833ae7d20f0d1069f64"
format_stamp: "Formatted at 2026-08-05 23:06:33 on dist-test-slave-1vmg"
server_key: "32b9d52def40acb8dccfa93efc74f21c"
server_key_iv: "f356f8cb243f6bcc292f99bc287c6335"
server_key_version: "encryptionkey@0"
I20260805 23:06:33.416061 21998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260805 23:06:33.455875 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 4
I20260805 23:06:33.457227 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.456696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43452)
0805 23:06:33.456927 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.457049 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260805 23:06:33.458384 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.457989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43462)
0805 23:06:33.458132 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.458224 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260805 23:06:33.458710 21884 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.45.124:33533: Network error: Client connection negotiation failed: client connection to 127.22.45.124:33533: connect: Connection refused (error 111)
I20260805 23:06:33.477106 21998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260805 23:06:33.482183 21998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260805 23:06:33.482494 21998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260805 23:06:33.501983 21998 rpc_server.cc:307] RPC server started. Bound to: 127.22.45.124:33533
I20260805 23:06:33.502004 22095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.45.124:33533 every 8 connection(s)
I20260805 23:06:33.503640 21998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/data/info.pb
I20260805 23:06:33.506079 22709 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu as pid 21998
I20260805 23:06:33.506289 22709 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskNZyF8v/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1785970804553337-22709-0/minicluster-data/master-2/wal/instance
I20260805 23:06:33.506870 22709 external_mini_cluster.cc:1428] Setting key 1893ff07c56a8692f6e58314d65ed836
I20260805 23:06:33.508733 22096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260805 23:06:33.518159 22096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971193, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
I20260805 23:06:33.532971 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.509691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43476 (local address 127.22.45.124:33533)
0805 23:06:33.510597 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.510614 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.510662 (+ 48us) server_negotiation.cc:407] Connection header received
0805 23:06:33.512446 (+ 1784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.512477 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.513013 (+ 536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.513494 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.515228 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.516707 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.518171 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.519040 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.519260 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.524380 (+ 5120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.524389 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.524401 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.524452 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.528196 (+ 3744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.529104 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.529115 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.529127 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.529382 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.529746 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.529752 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.529756 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.530479 (+ 723us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.530754 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.531323 (+ 569us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.531756 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":399,"threads_started":1}
I20260805 23:06:33.538745 22102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.521141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59516 (local address 127.22.45.126:38357)
0805 23:06:33.522644 (+ 1503us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.522651 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.522672 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:06:33.522738 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.522744 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.522825 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.522986 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.524296 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.525064 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.527291 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.527743 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.527849 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.531957 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.531963 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.531966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.532015 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.535306 (+ 3291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.536313 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.536318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.536320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.536475 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.536988 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.536994 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.536997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.537348 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.537538 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.538051 (+ 513us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.538300 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1372,"thread_start_us":1249,"threads_started":1}
I20260805 23:06:33.538775 22101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.521077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.126:38357 (local address 127.0.0.1:59516)
0805 23:06:33.521980 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.522026 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:33.522216 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:33.523087 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:33.523093 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:33.523822 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:33.524119 (+ 297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.524130 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.525257 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.525261 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.527100 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.527118 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.527958 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.527966 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.528183 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.528841 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:33.528860 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:33.531695 (+ 2835us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:33.535503 (+ 3808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.535514 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.535520 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.536163 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.536606 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.536611 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.536616 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.536818 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.537494 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:33.537503 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:33.537702 (+ 199us) client_negotiation.cc:769] Sending connection context
0805 23:06:33.537872 (+ 170us) client_negotiation.cc:240] Negotiation successful
0805 23:06:33.538288 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":398,"threads_started":1}
I20260805 23:06:33.540326 22096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.126@KRBTEST.COM
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971193, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:06:33.554100 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.536681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59526 (local address 127.22.45.126:38357)
0805 23:06:33.537316 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.537320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.537341 (+ 21us) server_negotiation.cc:407] Connection header received
0805 23:06:33.537386 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.537390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.537447 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.537558 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.539427 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.540429 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.542161 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.542714 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.542850 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.547824 (+ 4974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.547830 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.547833 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.547872 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.550808 (+ 2936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.551824 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.551831 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.551834 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.552055 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.552483 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.552487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.552489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.552813 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.553032 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.553431 (+ 399us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.553688 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":283,"threads_started":1}
I20260805 23:06:33.556974 22101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.541261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.125:38269 (local address 127.0.0.1:38280)
0805 23:06:33.541427 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.541444 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:33.541533 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:33.542530 (+ 997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:33.542536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:33.543135 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:33.543290 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.543299 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.544827 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.544830 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.545773 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.545786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.546618 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.546624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.546793 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.547423 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:33.547442 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:33.549704 (+ 2262us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:33.553577 (+ 3873us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.553583 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.553587 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.554159 (+ 572us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.555224 (+ 1065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.555228 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.555231 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.555406 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.556008 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:33.556014 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:33.556212 (+ 198us) client_negotiation.cc:769] Sending connection context
0805 23:06:33.556390 (+ 178us) client_negotiation.cc:240] Negotiation successful
0805 23:06:33.556728 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260805 23:06:33.557346 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.541700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38280 (local address 127.22.45.125:38269)
0805 23:06:33.542233 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.542237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.542253 (+ 16us) server_negotiation.cc:407] Connection header received
0805 23:06:33.542305 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.542310 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.542370 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.542459 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.543493 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.544650 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.545948 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.546430 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.546560 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.549973 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.549979 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.549982 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.550023 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.553407 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.554825 (+ 1418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.554832 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.554835 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.555059 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.555527 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.555532 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.555534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.555850 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.556026 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.556548 (+ 522us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.556827 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":269,"threads_started":1}
I20260805 23:06:33.558423 22096 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } has no permanent_uuid. Determining permanent_uuid...
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971193, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.124@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.45.125@KRBTEST.COM
I20260805 23:06:33.572136 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.559320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43478 (local address 127.22.45.124:33533)
0805 23:06:33.559467 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.559472 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.559488 (+ 16us) server_negotiation.cc:407] Connection header received
0805 23:06:33.559528 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.559532 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.559586 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.559663 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.560491 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.561592 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.563193 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.563580 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.563687 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.566809 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.566815 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.566820 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.566849 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.569481 (+ 2632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.570262 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.570267 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.570269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.570394 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.570798 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.570802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.570804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.571135 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.571254 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.571667 (+ 413us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.571864 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260805 23:06:33.572439 22101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.559100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43478)
0805 23:06:33.559244 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.559263 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:33.559357 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:33.559708 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:33.559712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:33.560154 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:33.560319 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.560330 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.561741 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.561746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.563061 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.563074 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.563729 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.563735 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.563921 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.564515 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:33.564533 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:33.566630 (+ 2097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:33.569653 (+ 3023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.569657 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.569660 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.570144 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.570519 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.570525 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.570528 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.570686 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.571250 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:33.571255 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:33.571424 (+ 169us) client_negotiation.cc:769] Sending connection context
0805 23:06:33.571606 (+ 182us) client_negotiation.cc:240] Negotiation successful
0805 23:06:33.572059 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":100}
I20260805 23:06:33.575126 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.556220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38282 (local address 127.22.45.125:38269)
0805 23:06:33.557977 (+ 1757us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.557982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.557999 (+ 17us) server_negotiation.cc:407] Connection header received
0805 23:06:33.558049 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.558065 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.558145 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.558246 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.560319 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.561210 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.562869 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.563642 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.563773 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.569065 (+ 5292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.569071 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.569074 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.569108 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.572209 (+ 3101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.573087 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.573093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.573096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.573281 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.573642 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.573646 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.573648 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.573973 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.574254 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.574492 (+ 238us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.574723 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1647,"thread_start_us":10889,"threads_started":1}
I20260805 23:06:33.578352 22096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: Bootstrap starting.
I20260805 23:06:33.580593 22709 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260805 23:06:33.582523 22096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:33.583940 22096 log.cc:824] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:33.583837 21846 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "a3254a69166547b7814c461e15286dff"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59526
I20260805 23:06:33.586874 22096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: No bootstrap required, opened a new log
I20260805 23:06:33.594086 22096 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.594444 22096 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2143a2362cc4833ae7d20f0d1069f64, State: Initialized, Role: FOLLOWER
I20260805 23:06:33.594944 22096 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.595980 22109 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.596410 22109 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:33.596971 22096 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [sys.catalog]: configured and running, proceeding with master startup.
W20260805 23:06:33.607435 22125 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:06:33.607666 22125 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 23:06:33.605033 21998 master_runner.cc:186] Error getting master registration for 127.22.45.126:38357: OK, instance_id { permanent_uuid: "a3254a69166547b7814c461e15286dff" instance_seqno: 1785971192306935 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 23:06:33.613724 21998 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260805 23:06:33.615310 21986 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 5
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.125@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
I20260805 23:06:33.631908 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.616271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43488 (local address 127.22.45.124:33533)
0805 23:06:33.616495 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.616501 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.616521 (+ 20us) server_negotiation.cc:407] Connection header received
0805 23:06:33.616573 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.616578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.616637 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.616735 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.617553 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.618290 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.619603 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.620271 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.620412 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.624523 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.624534 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.624540 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.624587 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.628504 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.629515 (+ 1011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.629521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.629525 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.629682 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.630173 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.630178 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.630181 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.630587 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.630764 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.631257 (+ 493us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.631519 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260805 23:06:33.631919 21991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.616040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43488)
0805 23:06:33.616241 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.616263 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:33.616391 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:33.616782 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:33.616787 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:33.617230 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:33.617394 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.617404 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.618433 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.618439 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.619462 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.619476 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.620464 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.620472 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.620755 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.621451 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:33.621470 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:33.624251 (+ 2781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:33.628713 (+ 4462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.628720 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.628725 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.629372 (+ 647us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.629828 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.629833 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.629837 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.630045 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.630721 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:33.630727 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:33.630946 (+ 219us) client_negotiation.cc:769] Sending connection context
0805 23:06:33.631129 (+ 183us) client_negotiation.cc:240] Negotiation successful
0805 23:06:33.631517 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260805 23:06:33.638617 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: Bootstrap starting.
I20260805 23:06:33.643174 21986 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:33.644614 21986 log.cc:824] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:33.648903 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: No bootstrap required, opened a new log
I20260805 23:06:33.660625 21986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.661123 21986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d88ae6e5c614bdcad579865bb23a3b3, State: Initialized, Role: FOLLOWER
I20260805 23:06:33.661707 21986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.662832 22132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.663298 22132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:33.664386 21986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [sys.catalog]: configured and running, proceeding with master startup.
W20260805 23:06:33.675686 22151 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260805 23:06:33.675933 22151 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260805 23:06:33.672834 21894 master_runner.cc:186] Error getting master registration for 127.22.45.126:38357: OK, instance_id { permanent_uuid: "a3254a69166547b7814c461e15286dff" instance_seqno: 1785971192306935 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260805 23:06:33.685297 21894 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260805 23:06:33.735095 22028 tablet.cc:2369] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:06:33.735908 21884 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } attempt: 5
Aug 05 23:06:33 dist-test-slave-1vmg krb5kdc[21765](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1785971192, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.45.126@KRBTEST.COM for kudu/127.22.45.124@KRBTEST.COM
I20260805 23:06:33.752950 21886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.736669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.45.124:33533 (local address 127.0.0.1:43504)
0805 23:06:33.736862 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0805 23:06:33.736884 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0805 23:06:33.737023 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0805 23:06:33.737606 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0805 23:06:33.737611 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0805 23:06:33.738088 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0805 23:06:33.738259 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.738270 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.739817 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.739823 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.740987 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0805 23:06:33.741005 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.742080 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.742086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0805 23:06:33.742308 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.743086 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0805 23:06:33.743111 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0805 23:06:33.746267 (+ 3156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0805 23:06:33.749937 (+ 3670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.749944 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.749949 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.750534 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.750999 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0805 23:06:33.751005 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0805 23:06:33.751009 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0805 23:06:33.751225 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0805 23:06:33.751775 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0805 23:06:33.751780 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0805 23:06:33.752025 (+ 245us) client_negotiation.cc:769] Sending connection context
0805 23:06:33.752187 (+ 162us) client_negotiation.cc:240] Negotiation successful
0805 23:06:33.752521 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260805 23:06:33.753615 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.737067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43504 (local address 127.22.45.124:33533)
0805 23:06:33.737275 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.737281 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.737299 (+ 18us) server_negotiation.cc:407] Connection header received
0805 23:06:33.737362 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.737368 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.737445 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.737548 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.738443 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.739643 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.741163 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.741924 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.742058 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.746537 (+ 4479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.746543 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.746547 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.746589 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.749730 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.750679 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.750683 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.750686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.750843 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.751345 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.751350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.751352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.751639 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.751792 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.752476 (+ 684us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.753359 (+ 883us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260805 23:06:33.759968 21884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff: Bootstrap starting.
I20260805 23:06:33.764587 21884 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff: Neither blocks nor log segments found. Creating new log.
I20260805 23:06:33.766260 21884 log.cc:824] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff: Log is configured to *not* fsync() on all Append() calls
I20260805 23:06:33.776170 21884 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff: No bootstrap required, opened a new log
I20260805 23:06:33.783866 21884 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.784435 21884 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3254a69166547b7814c461e15286dff, State: Initialized, Role: FOLLOWER
I20260805 23:06:33.785048 21884 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.786463 22156 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.787230 22156 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:33.788038 21884 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: configured and running, proceeding with master startup.
I20260805 23:06:33.788079 21846 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260805 23:06:33.788331 21846 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:33.792694 21846 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.794688 21846 leader_election.cc:288] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [CANDIDATE]: Term 1 election: Requested vote from peers 0d88ae6e5c614bdcad579865bb23a3b3 (127.22.45.125:38269), d2143a2362cc4833ae7d20f0d1069f64 (127.22.45.124:33533)
W20260805 23:06:33.795866 21821 tablet.cc:2369] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:06:33.796139 22057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3254a69166547b7814c461e15286dff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d2143a2362cc4833ae7d20f0d1069f64"
I20260805 23:06:33.796203 21952 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a3254a69166547b7814c461e15286dff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0d88ae6e5c614bdcad579865bb23a3b3"
I20260805 23:06:33.796695 22057 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:33.796698 21952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [term 0 FOLLOWER]: Advancing to term 1
I20260805 23:06:33.801106 22057 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3254a69166547b7814c461e15286dff in term 1.
I20260805 23:06:33.802008 21815 leader_election.cc:302] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a3254a69166547b7814c461e15286dff, d2143a2362cc4833ae7d20f0d1069f64; no voters:
I20260805 23:06:33.802439 21952 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3254a69166547b7814c461e15286dff in term 1.
I20260805 23:06:33.802654 22156 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [term 1 FOLLOWER]: Leader election won for term 1
I20260805 23:06:33.822340 22156 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [term 1 LEADER]: Becoming Leader. State: Replica: a3254a69166547b7814c461e15286dff, State: Running, Role: LEADER
I20260805 23:06:33.823271 22156 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } }
I20260805 23:06:33.833374 22161 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3254a69166547b7814c461e15286dff. Latest consensus state: current_term: 1 leader_uuid: "a3254a69166547b7814c461e15286dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.833740 22161 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:33.834645 22173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260805 23:06:33.856465 22173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260805 23:06:33.870826 21919 tablet.cc:2369] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260805 23:06:33.876384 22191 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260805 23:06:33.879326 22057 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [term 1 FOLLOWER]: Refusing update from remote peer a3254a69166547b7814c461e15286dff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:06:33.880744 22161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:06:33.892589 22103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.845783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59532 (local address 127.22.45.126:38357)
0805 23:06:33.846073 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.846081 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.860852 (+ 14771us) server_negotiation.cc:407] Connection header received
0805 23:06:33.866291 (+ 5439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.866299 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.866420 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.866507 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.877761 (+ 11254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.878860 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.880793 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.881454 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.881555 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.885108 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.885115 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.885120 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.885177 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.888922 (+ 3745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.889926 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.889933 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.889936 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.890106 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.890617 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.890623 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.890626 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.891038 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.891277 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.891975 (+ 698us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.892252 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260805 23:06:33.893424 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.845566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38284 (local address 127.22.45.125:38269)
0805 23:06:33.845758 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.845764 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.851622 (+ 5858us) server_negotiation.cc:407] Connection header received
0805 23:06:33.851960 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.851968 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.852090 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.852189 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.859130 (+ 6941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.860357 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.862438 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.863226 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.863351 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.874288 (+ 10937us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.874297 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.874302 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.874353 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.878519 (+ 4166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.890292 (+ 11773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.890299 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.890303 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.890520 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.891076 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.891083 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.891087 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.891511 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.891786 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.892750 (+ 964us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.893051 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260805 23:06:33.908000 22100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:33.851884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43520 (local address 127.22.45.124:33533)
0805 23:06:33.852186 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:33.852192 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:33.871637 (+ 19445us) server_negotiation.cc:407] Connection header received
0805 23:06:33.871929 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:33.871936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:33.872054 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:33.872132 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:33.887080 (+ 14948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.888193 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.894601 (+ 6408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:33.895405 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:33.895521 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:33.899629 (+ 4108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0805 23:06:33.899637 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0805 23:06:33.899642 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0805 23:06:33.899694 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0805 23:06:33.903990 (+ 4296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.905195 (+ 1205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.905202 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.905206 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.905400 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0805 23:06:33.905929 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0805 23:06:33.905934 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0805 23:06:33.905938 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0805 23:06:33.906394 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0805 23:06:33.906652 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:33.907309 (+ 657us) server_negotiation.cc:299] Negotiation successful
0805 23:06:33.907595 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260805 23:06:33.909071 21952 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [term 1 FOLLOWER]: Refusing update from remote peer a3254a69166547b7814c461e15286dff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260805 23:06:33.910382 22161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260805 23:06:33.941917 22132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3254a69166547b7814c461e15286dff. Latest consensus state: current_term: 1 leader_uuid: "a3254a69166547b7814c461e15286dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.942341 22132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:33.948803 22189 mvcc.cc:205] Tried to move back new op lower bound from 7315338010111004672 to 7315338009907957760. Current Snapshot: MvccSnapshot[applied={T|T < 7315338010111004672}]
I20260805 23:06:33.956341 22193 mvcc.cc:205] Tried to move back new op lower bound from 7315338010111004672 to 7315338009907957760. Current Snapshot: MvccSnapshot[applied={T|T < 7315338010111004672}]
I20260805 23:06:33.960569 22109 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3254a69166547b7814c461e15286dff. Latest consensus state: current_term: 1 leader_uuid: "a3254a69166547b7814c461e15286dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.961009 22109 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:33.965265 22161 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3254a69166547b7814c461e15286dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.965552 22161 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:33.965721 22132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3254a69166547b7814c461e15286dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.966015 22132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:33.972738 22156 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a3254a69166547b7814c461e15286dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.973603 22156 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff [sys.catalog]: This master's current role is: LEADER
I20260805 23:06:33.978372 22173 catalog_manager.cc:1347] Generated new cluster ID: 2e4fc8591c9044208bd44592132eec13
I20260805 23:06:33.978509 22173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260805 23:06:33.983176 22109 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a3254a69166547b7814c461e15286dff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a3254a69166547b7814c461e15286dff" member_type: VOTER last_known_addr { host: "127.22.45.126" port: 38357 } } peers { permanent_uuid: "0d88ae6e5c614bdcad579865bb23a3b3" member_type: VOTER last_known_addr { host: "127.22.45.125" port: 38269 } } peers { permanent_uuid: "d2143a2362cc4833ae7d20f0d1069f64" member_type: VOTER last_known_addr { host: "127.22.45.124" port: 33533 } } }
I20260805 23:06:33.983491 22109 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64 [sys.catalog]: This master's current role is: FOLLOWER
I20260805 23:06:34.010898 22173 catalog_manager.cc:1370] Generated new certificate authority record
I20260805 23:06:34.015237 22173 catalog_manager.cc:1504] Loading token signing keys...
I20260805 23:06:34.045324 22173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3254a69166547b7814c461e15286dff: Generated new TSK 0
I20260805 23:06:34.046691 22173 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260805 23:06:34.203244 22103 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.179404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59542 (local address 127.22.45.126:38357)
0805 23:06:34.179631 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.179638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.197477 (+ 17839us) server_negotiation.cc:407] Connection header received
0805 23:06:34.201223 (+ 3746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.201232 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.201362 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.201443 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.202860 (+ 1417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59542: BlockingRecv error: recv got EOF from 127.0.0.1:59542 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260805 23:06:34.208333 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.181367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38292 (local address 127.22.45.125:38269)
0805 23:06:34.181592 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.181599 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.205638 (+ 24039us) server_negotiation.cc:407] Connection header received
0805 23:06:34.206516 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.206523 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.206617 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.206694 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.208013 (+ 1319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38292: BlockingRecv error: recv got EOF from 127.0.0.1:38292 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260805 23:06:34.211102 22100 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.198232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43526 (local address 127.22.45.124:33533)
0805 23:06:34.198471 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.198478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.206219 (+ 7741us) server_negotiation.cc:407] Connection header received
0805 23:06:34.209275 (+ 3056us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.209281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.209376 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.209451 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.210751 (+ 1300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43526: BlockingRecv error: recv got EOF from 127.0.0.1:43526 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260805 23:06:34.222061 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.219377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38294 (local address 127.22.45.125:38269)
0805 23:06:34.219584 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.219590 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.220216 (+ 626us) server_negotiation.cc:407] Connection header received
0805 23:06:34.220478 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.220485 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.220635 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.220763 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.221765 (+ 1002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38294: BlockingRecv error: recv got EOF from 127.0.0.1:38294 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260805 23:06:34.231951 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.229430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38308 (local address 127.22.45.125:38269)
0805 23:06:34.229639 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.229645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.230223 (+ 578us) server_negotiation.cc:407] Connection header received
0805 23:06:34.230425 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.230433 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.230568 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.230711 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.231669 (+ 958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38308: BlockingRecv error: recv got EOF from 127.0.0.1:38308 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260805 23:06:34.243748 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.237607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38318 (local address 127.22.45.125:38269)
0805 23:06:34.237809 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.237815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.238362 (+ 547us) server_negotiation.cc:407] Connection header received
0805 23:06:34.238595 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.238602 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.238707 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.238839 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.243480 (+ 4641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38318: BlockingRecv error: recv got EOF from 127.0.0.1:38318 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260805 23:06:34.256177 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.253311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38334 (local address 127.22.45.125:38269)
0805 23:06:34.253872 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.253879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.254457 (+ 578us) server_negotiation.cc:407] Connection header received
0805 23:06:34.254677 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.254687 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.254794 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.254959 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.255900 (+ 941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38334: BlockingRecv error: recv got EOF from 127.0.0.1:38334 (error 108)
Metrics: {"server-negotiator.queue_time_us":375}
W20260805 23:06:34.271559 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.268989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38350 (local address 127.22.45.125:38269)
0805 23:06:34.269213 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.269220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.269827 (+ 607us) server_negotiation.cc:407] Connection header received
0805 23:06:34.270031 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.270038 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.270171 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.270292 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.271292 (+ 1000us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38350: BlockingRecv error: recv got EOF from 127.0.0.1:38350 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260805 23:06:34.295809 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.293174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38364 (local address 127.22.45.125:38269)
0805 23:06:34.293405 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.293412 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.294046 (+ 634us) server_negotiation.cc:407] Connection header received
0805 23:06:34.294287 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.294293 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.294396 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.294522 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.295548 (+ 1026us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38364: BlockingRecv error: recv got EOF from 127.0.0.1:38364 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
W20260805 23:06:34.334065 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.331620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38366 (local address 127.22.45.125:38269)
0805 23:06:34.331887 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.331894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.332506 (+ 612us) server_negotiation.cc:407] Connection header received
0805 23:06:34.332775 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.332780 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.332861 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.332952 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.333808 (+ 856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38366: BlockingRecv error: recv got EOF from 127.0.0.1:38366 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260805 23:06:34.404222 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.402036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38372 (local address 127.22.45.125:38269)
0805 23:06:34.402275 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.402283 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.402626 (+ 343us) server_negotiation.cc:407] Connection header received
0805 23:06:34.402812 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.402819 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.402968 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.403111 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.403954 (+ 843us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38372: BlockingRecv error: recv got EOF from 127.0.0.1:38372 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260805 23:06:34.537884 22105 negotiation.cc:337] Failed RPC negotiation. Trace:
0805 23:06:34.536124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38376 (local address 127.22.45.125:38269)
0805 23:06:34.536288 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.536293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.536581 (+ 288us) server_negotiation.cc:407] Connection header received
0805 23:06:34.536747 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.536752 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.536827 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.536914 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0805 23:06:34.537684 (+ 770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38376: BlockingRecv error: recv got EOF from 127.0.0.1:38376 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260805 23:06:34.609895 22125 catalog_manager.cc:1259] Loaded cluster ID: 2e4fc8591c9044208bd44592132eec13
I20260805 23:06:34.610023 22125 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: loading cluster ID for follower catalog manager: success
I20260805 23:06:34.612768 22125 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: acquiring CA information for follower catalog manager: success
I20260805 23:06:34.614768 22125 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d2143a2362cc4833ae7d20f0d1069f64: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 23:06:34.678086 22151 catalog_manager.cc:1259] Loaded cluster ID: 2e4fc8591c9044208bd44592132eec13
I20260805 23:06:34.678215 22151 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: loading cluster ID for follower catalog manager: success
I20260805 23:06:34.680891 22151 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: acquiring CA information for follower catalog manager: success
I20260805 23:06:34.682904 22151 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0d88ae6e5c614bdcad579865bb23a3b3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260805 23:06:34.804577 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:34.798473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39288 (local address 127.22.45.125:38269)
0805 23:06:34.798686 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.798693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.799112 (+ 419us) server_negotiation.cc:407] Connection header received
0805 23:06:34.799358 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.799364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.799540 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.799662 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:34.800084 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.800904 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.802345 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.802755 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.802868 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:34.803439 (+ 571us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:34.804029 (+ 590us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:34.804152 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:34.804263 (+ 111us) server_negotiation.cc:299] Negotiation successful
0805 23:06:34.804358 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260805 23:06:34.816627 22294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:34.810810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51674 (local address 127.22.45.124:33533)
0805 23:06:34.811309 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.811314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.811402 (+ 88us) server_negotiation.cc:407] Connection header received
0805 23:06:34.811634 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.811638 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.811816 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.812012 (+ 196us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:34.812404 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.813133 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.814431 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.814838 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.814971 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:34.815484 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:34.816065 (+ 581us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:34.816199 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:34.816260 (+ 61us) server_negotiation.cc:299] Negotiation successful
0805 23:06:34.816343 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":275,"threads_started":1}
I20260805 23:06:34.830082 22105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:34.822717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39294 (local address 127.22.45.125:38269)
0805 23:06:34.822944 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.822952 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.823412 (+ 460us) server_negotiation.cc:407] Connection header received
0805 23:06:34.823778 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.823786 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.823902 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.824012 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:34.824880 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.825904 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.828029 (+ 2125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.828481 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.828604 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:34.829186 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:34.829336 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:34.829430 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:34.829683 (+ 253us) server_negotiation.cc:299] Negotiation successful
0805 23:06:34.829791 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260805 23:06:34.831619 22294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:34.824806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51690 (local address 127.22.45.124:33533)
0805 23:06:34.824998 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.825004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.825608 (+ 604us) server_negotiation.cc:407] Connection header received
0805 23:06:34.825783 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.825788 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.825878 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.825983 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:34.826658 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.827725 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.829597 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.830210 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.830326 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:34.830867 (+ 541us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:34.831035 (+ 168us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:34.831133 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:34.831272 (+ 139us) server_negotiation.cc:299] Negotiation successful
0805 23:06:34.831354 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260805 23:06:34.831679 22302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0805 23:06:34.822784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57478 (local address 127.22.45.126:38357)
0805 23:06:34.824098 (+ 1314us) server_negotiation.cc:206] Beginning negotiation
0805 23:06:34.824104 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0805 23:06:34.824431 (+ 327us) server_negotiation.cc:407] Connection header received
0805 23:06:34.824646 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0805 23:06:34.824651 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0805 23:06:34.824900 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0805 23:06:34.825098 (+ 198us) server_negotiation.cc:226] Negotiated authn=TOKEN
0805 23:06:34.825906 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.826971 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.828739 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0805 23:06:34.829290 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0805 23:06:34.829404 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0805 23:06:34.830064 (+ 660us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0805 23:06:34.830545 (+ 481us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0805 23:06:34.830673 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0805 23:06:34.831207 (+ 534us) server_negotiation.cc:299] Negotiation successful
0805 23:06:34.831303 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1177,"thread_start_us":1046,"threads_started":1}
I20260805 23:06:34.835996 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21792
I20260805 23:06:34.837324 21872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:34.953963 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 21792
I20260805 23:06:34.981720 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21894
I20260805 23:06:34.983040 21977 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:35.094475 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 21894
I20260805 23:06:35.119424 22709 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu pid 21998
I20260805 23:06:35.120625 22087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260805 23:06:35.228956 22709 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskNZyF8v/build/asan/bin/kudu with pid 21998
2026-08-05T23:06:35Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4964 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9820 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (390641 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST